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Preface 

O ne of the primary objectives of the SeaWiFS Project, as stated in Volume 1 of this technical memorandum 
series (Hooker et al. 1992), is “to achieve radiometric accuracy of 5% absolute and 1% relative, water- 
leaving radiances to within 5% absolute, and chlorophyll a concentration to within 35% over the range of 0.05- 
50.0 mg m~ 3 .” This objective presents a challenge to the ocean color community, and the SeaWiFS Calibration 
and Validation Team (CVT) has initiated a number of activities directed towards attaining these accuracy goals 
which include 

1) The SeaWiFS Intercalibration Round- Robin Experiments (SIRREXs), 

2) The development of in situ measurement protocols (Mueller and Austin 1992 and 1995), 

3) The construction of the SeaWiFS transfer radiometer (SXR), 

4) Support for the Marine Optical Buoy (MOBY), and 

5) Support for the collection of high quality bio-optical data sets. 

These activities address the issues of instrument calibration, data collection techniques, and bio-optical data set 
diversity. 

An additional aspect to the problem is the methodology by which vertical profiling radiometric observations are 
extrapolated to the surface so field observations can be compared with the satellite derived products or used 
as inputs for satellite bio-optical algorithms. The first SeaWiFS Data Analysis Round-Robin (DARR-94) was 
convened for the purpose of comparing the various techniques being used by the ocean color community, to 
clarify the sources of error, and work toward establishing standard methods for deriving the relevant products, 
e.g., water- leaving radiance and diffuse attenuation. This technical memorandum summarizes the results of 
DARR-94 and establishes that careful data analysis is necessary and that errors in the analysis can lead to very 
large errors in the derived fields. As a result of DARR-94, it is clear that continued refinement of radiometric 
data analysis techniques is necessary. Therefore, as with the instrument round- robins, the CVT will promote 
additional analysis round-robins in a continuing effort to attain the SeaWiFS mission objectives. 

Greenbelt, Maryland — C. R. McClain 

February 1995 
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Abstract 

The accurate determination of upper ocean apparent optical properties (AOPs) is essential for the vicarious 
calibration of the Sea-viewing Wide Field-of-view Sensor (SeaWiFS) instrument and the validation of the derived 
data products. To evaluate the role that data analysis methods have upon values of derived AOPs, the first 
Data Analysis Round- Robin (DARR-94) workshop was sponsored by the SeaWiFS Project during 21-23 July, 
1994. The focus of this intercomparison study was the estimation of the downwelling irradiance spectrum just 
beneath the sea surface, E d ( 0" , A); the upwelling nadir radiance just beneath the sea surface, L u ( 0" , A); and the 
vertical profile of the diffuse attenuation coefficient spectrum, K d (z, A). In the results reported here, different 
methodologies from four research groups were applied to an identical set of 10 spectroradiometry casts in order 
to evaluate the degree to which data analysis methods influence AOP estimation, and whether any general 
improvements can be made. The overall results of DARR-94 are presented in Chapter 1 and the individual 
methods of the four groups are presented in Chapters 2-5. The DARR-94 results do not show a clear winner 
among data analysis methods evaluated. It is apparent, however, that some degree of outlier rejection is required 
in order to accurately estimate T u (0 , A) or E d ( 0“, A). Furthermore, the calculation, evaluation and exploitation 
of confidence intervals for the AOP determinations needs to be explored. That is, the SeaWiFS calibration and 
validation problem should be recast in statistical terms where the in situ AOP values are statistical estimates 
with known confidence intervals. 


PROLOGUE 

The Sea-viewing Wide Field-of-view Sensor (SeaWiFS) 
Project is tasked with executing a program to acquire the 
global SeaWiFS data set, validate and monitor its accuracy 
and quality, process the radiometric data into geophysical 
units using a set of atmospheric and bio-optical algorithms, 
and distribute the final products to the scientific commu- 
nity through the Goddard Space Flight Center (GSFC) 
Distributed Active Archive Center (DA AC). The SeaWiFS 
data products are prominent components of major scien- 
tific programs studying global climate change, including 
the Joint Global Ocean Flux Study (JGOFS), the World 
Ocean Circulation Experiment (WOCE), and the Global 
Ocean Ecosystems dynamics (GLOBEC) programs. 

The accurate determination of upper ocean apparent 
optical properties (AOPs) is essential for the vicarious cal- 
ibration of the SeaWiFS instrument and the validation of 
the derived data products. The only economically feasi- 
ble approach for minimizing spatial biases is to maximize 
the acquisition of global in situ measurements by solicit- 
ing contributions of data from the oceanographic commu- 
nity at large, and to combine them with data collected 
from SeaWiFS sponsored activities into a single database. 
The SeaWiFS Calibration and Validation Team (CVT) 
have responded to this need by implementing the SeaWiFS 
Bio-Optical Archive and Storage System (SeaBASS). Data 
from a variety of sources are expected to go into this data- 
base including 

■ The Bermuda Bio-Optics Project (BBOP), 

■ The Bermuda Atlantic Time-series Study (BATS), 

■ The California Cooperative Fisheries Institute (Cal- 
CoFI), 


■ The JGOFS Equatorial Pacific (EqPac) process 
study, 

■ The Gulf of Mexico Experiment (GOMEX), and 

■ The Tropical Ocean Global Atmosphere (TOGA) 
Coupled Ocean-Atmosphere Response Experiment 
(COARE). 

The accuracy of any AOP determination is a function 
of the quality of the measurement, and the differences in 
the data analysis method employed. In order to minimize 
observational errors, the SeaWiFS Project has sponsored a 
variety of multidisciplinary workshops to outline the obser- 
vations and sampling protocols required for bio-optical al- 
gorithm development (Mueller and Austin 1992 and 1995). 
One of the consequences of the workshops was the estab- 
lishment of a series of SeaWiFS Intercalibration Round- 
Robin Experiment (SIRREX) activities to establish and 
advance the state of the art for calibrating the instruments 
used in field activities, e.g., the Marine Environmental Ra- 
diometers (MERs). 

Although the SeaBASS architecture allows for some 
quality control (Hooker et al. 1994), it is based primar- 
ily on resolving obvious clerical errors in the reporting of 
where and when data acquisiton activities took place—it 
does not attempt to quantify differences in the data anal- 
ysis methods employed. The latter is, in part, a function 
of how the individual software packages deal with data de- 
spiking, binning and smoothing, and removing possible ar- 
tifacts from changes in surface illumination, ship shadow, 
or reflections and wave focusing. 

The focus of this intercomparison study is the estima- 
tion of the downwelling irradiance spectrum just beneath 
the sea surface, E d ( 0~,A), the upwelling nadir radiance 
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just beneath the sea surface, L u { 0 _ ,A), and the verti- 
cal profile of the diffuse attenuation coefficient spectrum, 
Kd(z, A). In the results reported here, different method- 
ologies from four research groups are applied to the afore- 
mentioned spectroradiometry profiles in order to evaluate 
the degree to which data analysis methods influence AOP 
estimation, and whether any general improvements can be 
made. The four groups involved were as follows: 

1. The University of California at Santa Barbara 
(UCSB) Institute for Computational Earth Sys- 
tem Science (ICESS), 

2. San Diego State University (SDSU) Center for 
Hydro-Optics and Remote Sensing (CHORS), 

3. The Naval Research Laboratory (NRL), and 

4. Scripps Institution of Oceanography (SIO). 

The overall results of the first Data Analysis Round-Robin 
(DARRone) are presented in Chapter 1 and the individual 
methods of the four groups are presented in Chapters 2-5, 
respectively. The attendees to the workshop are given in 
Appendix A. A summary of the material presented in each 
Chapter is given below. 

1. The First SeaWiFS Ocean Optics DARR 

This study shows that with good data (near-constant 
incident irradiance), the different analyses produce esti- 
mates of L u (0 _ ,A) and £d(0~,A) that are within 3-4% 
of the aggregate mean value. The statistical uncertainty 
in determining i?d(0~,A) are considerably larger (approx- 
imately 7%) than those for L u (0~,A) (about 2%). These 
differences can be attributed to geophysical noise sources in 
the raw data streams which appear to be primarily due to 
the aliasing of surface wave induced glinting in the vertical 
radiometric profiles. Furthermore, the profile of the diffuse 
attenuation coefficient spectrum, Kd{z, A), can be repli- 
cated to better than 5% with the different analyses. These 
differences account for much of the total 5% uncertainty 
that is tolerated for SeaWiFS calibration and validation 
purposes (Mueller and Austin 1995). For bad data, large 
deviations among methods occur. The DARR-94 results 
do not show a clear winner among data analysis meth- 
ods evaluated. It is apparent, however, that some degree 
of outlier rejection is required in order to accurately es- 
timate L u ( 0“,A) or Ed{ 0~,A). Possible solutions include 
manual or automated data disqualification, robust curve 
fitting routines, or extrapolation using the incident flux 
(not fully evaluated in this study). Furthermore, the calcu- 
lation, evaluation and exploitation of confidence intervals 
for the AOP determinations needs to be explored; that is, 
the SeaWiFS calibration and validation problem should be 
recast in statistical terms where the in situ AOP values are 
statistical estimates with known confidence intervals. This 
is critical for the long-term assessment of ocean color im- 
agery and its calibration and validation using in situ data 
sets. Finally, there is no substitute for good in situ data 


for accurately determining AOPs. Good at-sea procedures 
and clear skies are essential and cannot be over empha- 
sized. 

2. The BBOP Data Processing System 

The BBOP group has developed a data analysis method 
based on the philosophy that they will take more casts then 
they need. For example, the BBOP collects over 1,000 pro- 
files each year in order to link time-series observations of 
primary production rates to bio-optical parameters. This 
means suspect data will be flagged and eliminated from 
future consideration rather than corrected. A computer 
data processing system capable of efficiently calibrating, 
processing, reducing, analyzing, and interpreting the data 
in a timely manner is presented. The processing system is 
comprised of a suite of American National Standards In- 
stitute (ANSI) C++ programs that read and operate on a 
specified file format, the least common denominator (LCD) 
data file. The LCD file contains all relevant data and 
metadata, which include calibration information and at- 
sea comments, in a single easy-to-read file that conforms 
to American Standard Code for Information Interchange 
(ASCII) standards. UNIX shell scripts are used in the 
control of data flow as well as error and log handling. The 
final product is a binned spectroradiometer data set with 
relevant derived parameters included [/Q(z, A), R r9 (z, A), 
Ed{0~, A), etc.] that may be disseminated to other groups 
or databases. 

3 . Integra] Method for Analyzing Irradiance and 

Radiance Attenuation Profiles 

The CHORS group has taken a very different approach 
and has developed an integral method for determining the 
slope of the log-transformed irradiance profile, Kd(z> A), 
and its intercepts, L u { 0“,A) and I^(0 - ,A). Their analy- 
sis goals are driven by the fact that they must make good 
estimates of AOPs from every cast in order to meet their 
own as well as their colleagues 1 scientific objectives. The 
CHORS method determines the profile of K for a vertical 
profile of irradiance or radiance through a least-squares fit 
to the optical depth profile, expressed as the integral of K 
from the surface to each depth z . The measured optical 
depth at each 2 is calculated as the natural logarithm of 
the surface-to-depth ratio of measured irradiances (or radi- 
ances). The K profile is represented analytically by Hermi- 
tian cubic polynomials connecting nodes at several discrete 
depths, with unknown values of K and its vertical deriva- 
tive at each node as coefficients. These polynomials are 
integrated analytically to each z, which allows each mea- 
sured optical depth to be set equal to a polynomial with 
node values of K and its derivative at the node depths. 
This results in an overdetermined set of equations corre- 
sponding to all measured depths in the irradiance (or radi- 
ance) profile, which is solved using classical least-squares 
methods. Prior to solution, irradiance data are normal- 
ized to minimize effects of surface irradiance variations, 
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and segments near major anomalies (re siting from strong 
cloud shadows or ship shadows) are elim nated from the fit. 
In contrast to the classical derivative solutions for K , the 
integral approach ensures a correct representation of total 
attenuation through missing data intervals. The CHORS 
method utilizes human-selected data rejection and node 
setting, and is developed with a sophisticated graphical 
user interface (GUI). It should be noted that the determi- 
nation of the L u ( 0" , A) and E d (0 ~ , A) values strongly affect 
the fit to the entire profile. 

4. Automated and Interactive Bio-Opticai 

Processing Package 

The NRL method has been developed with the same 
analysis goal as the CHORS method. Namely, they need 
to make accurate determinations of AOPs from every cast 
during a cruise to achieve their science goals. NRL has 
developed a multiple level, prediction-correction software 
package called Automated and Interactive Bio-Optical Pro- 
cessing (AIBOP). The data is processed in two parts: first 
the is despiked and binned using an automated routine, 
and second, the effects of changes in surface illumination, 
ship shadow, or reflection and near surface effects (such 
as wave focusing) are removed using interactive spectral 


processing. The second level method is not used for the 
DARR-94 comparisons as many of the data sets used were 
missing required data types. Once the data is processed, 
routines are provided for calculating extinction coefficients, 
surface radiance and irradiance values, and remote sensing 
reflectance. 

5. The SIO Method 

For DARR-94, the SIO group employed a bulk method 
for deriving AOPs from spectroradiometry profiles. The 
bulk approach has been long employed in the past and 
much of what is known about AOPs has come from us- 
ing this approach. The bulk method has been used in 
the past by the SIO group, although, they are not doing 
so presently. The bulk approach fits a straight line to the 
log-transformed irradiance and radiance profiles within the 
oceanic mixed layer. The fluxes just below the sea surface 
are estimated from the exponentiated intercept and the 
slope gives a mixed layer averaged diffuse attenuation co- 
efficient, K d (z 0 ,\). This method provides only a single 
estimate of K d (zo, A) and cannot be used to determine the 
depth dependence of K d (z, A). One distinct advantage of 
the bulk method is that it can easily be applied using any 
spreadsheet program on a personal computer (PC). 
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Chapter 1 


The First SeaWiFS Ocean Optics DARR 

David A. Siegel, Margaret C. O’Brien, and Jens C. Sorensen 
University of California , Santa Barbara, Santa Barbara , California 

Abstract 

The focus of this intercomparison study is the estimation of the downweiling irradiance spectrum just beneath 
the sea surface, £d(0~ , A), the upwelling nadir radiance just beneath the sea surface, L u (0~, A), and the vertical 
profile of the diffuse attenuation coefficient spectrum, Kd{z, A). This study shows that with good data (near- 
constant incident irradiance), the different analyses produce estimates of L u ( 0“, A) and Ed(0~ , A) that are within 
3-4% of the aggregate mean value. The statistical uncertainties in determinations of Ed(0 ~ , A) are considerably 
larger (approximately 7%) than those for L u ( 0~,A) (about 2%), as found using the BBOP analyzed results. 
These differences can be attributed to geophysical noise sources in the raw data streams which appear to be 
primarily due to the aliasing of surface wave induced glinting in the vertical radiometric profiles. Furthermore, 
the profile of the diffuse attenuation coefficient spectrum, Ad(z,A), can be replicated to better than 5% with 
the different analyses. These differences account for much of the total 5% uncertainty that is tolerated for 
SeaWiFS calibration and validation purposes (Mueller and Austin 1995). For bad data, large deviations among 
methods occur. The DARR-94 results do not show a clear winner among data analysis methods evaluated. It is 
apparent, however, that some degree of outlier rejection is required in order to accurately estimate L u (0~, A) or 
£d(0~^)- Possible solutions include manual or automated data disqualification, robust curve fitting routines, or 
extrapolation using the incident flux (not fully evaluated in this study). Furthermore, the calculation, evaluation 
and exploitation of confidence intervals for the AOP determinations needs to be explored. That is, the SeaWiFS 
calibration and validation problem should be recast in statistical terms where the in situ AOP values are 
statistical estimates with known confidence intervals. This is critical for the long-term assessment of ocean color 
imagery and its calibration and validation using in situ data sets. Last, there is no substitute for good in situ 
data for accurately determining AOPs. Good at-sea procedures and clear skies are essential and cannot be over 
emphasized. 


1.1 INTRODUCTION 

Accurate determinations of upper ocean AOPs are es- 
sential for the vicarious calibration and validation of the 
SeaWiFS instrument --and its derived data products (Mc- 
Clain et al. 1992 and Mueller and Austin 1995). To date, 
much of the effort in the SeaWiFS CVT has been spent 
on the radiometric calibration of at-sea optical instrumen- 
tation and on the development of protocols for deploying 
them (e.g., Mueller et al. 1994 and Mueller and Austin 
1995). These efforts have produced significant and impor- 
tant improvements in the SeaWiFS research community’s 
ability to provide accurate AOP estimates for SeaWiFS 
calibration and validation, as well as algorithm develop- 
ment requirements. The correct deployment of accurate 
spectroradiometric instrumentation, however, is only the 
first step in making accurate determinations of AOPs. 

In order to calculate AOPs using a vertically profil- 
ing spectroradiometer, a number of critical assumptions 


must be made concerning how the data is handled. For 
example, to determine the water-leaving radiance from a 
near-surface profile of upwelled spectral radiance, L u (z, A), 
one must numerically extrapolate the profile from depth 
to just beneath the sea surface (where z=0“). Difficul- 
ties arise due to superposition of the time course signals 
from surface gravity waves and random variations in pack- 
age orientation, as well as ship shadows, upon the time 
mean upwelled radiance profile. These factors can lead 
to noise in spectroradiometry data. Hence, least-squares 
estimation methods are generally used to objectively ex- 
trapolate L u {z y A) determinations to the sea surface to es- 
timate L u (0 ~ , A), the upwelling radiance spectrum just be- 
neath the sea surface. This procedure has been applied by 
many investigators (e.g.. Smith and Baker 1984, Smith and 
Baker 1986, Siegel and Dickey 1987, Sorensen et al. 1994, 
and Siegel et al. 1995a) and is recommended by the Sea- 
WiFS Ocean Optics Protocols (Mueller and Austin 1995). 
However, a variety of procedural questions remain which 
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may impact the derived value of L u ( 0 , A): 

1. Are L u (z, A) data vertically smoothed before ex- 
trapolation to the sea surface? 

2. Is the data binned vertically before calculating 
L u ( 0“,A)? 

3. How are ship shadows excluded? 

4. How is a surface sensor used if one is available? 

5. What effect(s) do these decisions have on an es- 
timate of L u { 0 _ ,A)? 

6. How about other important AOPs? 

To evaluate the role that data analysis methods have 
upon values of derived AOPs, the DARR-94 workshop was 
sponsored by the SeaWiFS Project Office during July 21- 
23, 1994 at ICESS (UCSB). Four research groups used 
their standard spectroradiometer data analysis routines 
(Table 1) on an identical data set of 10 spectroradiome- 
try casts. The goal of DARR-94 was to assess the degree 
to which data analysis methods affect AOP estimation and 
to make general recommendations where applicable. This 
assessment is critical as fully processed spectroradiometry 
data will be used to calibrate and validate the SeaWiFS 
satellite data stream. Hence, the direct comparisons of 
the results of the four data analysis methods will put some 
bounds on the degree of certainty for AOP estimates and 
their effects upon the calibration and validation of the up- 
coming SeaWiFS ocean color mission. 


Table 1 . A listing of data contributors for DARR-94 
along with their methods and primary study sites. 


Contact 

Method 

Primary Site 

D. Siegel 

Differential! 

JGOFS BATS 
TOGA COARE 

J. Mueller 

Integral 

Gulf of Mexico 
Gulf of California 

C. Davis 

Differential! 

JGOFS EqPac 
Arabian Sea 

G. Mitchell 

Bulk 

CalCoFI 


f With confidence intervals and quality flags. 

\ With sea surface and surface irradiance adjustments. 


This study evaluates and documents the magnitude of 
uncertainty in derived estimates of ocean color relevant 
AOPs due to differences in data analysis methods. In 
particular, estimates of the spectrum of upwelling radi- 
ance and downwelling irradiance just beneath the sea sur- 
face, L u ( 0",A) and £^(0", A), respectively, and the verti- 
cal profile of the diffuse attenuation coefficient spectrum, 
K d (z, A), are considered in detail. The approach taken for 
the DARR-94 is rather simple. Each of the four research 
groups (Table 1) provided up to three spectroradiome- 
try casts (discussed below) and each group analyzes the 
data to relevant AOPs. The resulting values of L u (0“, A) 


and E d ( 0~,A) and vertical profiles of K d (z,\) are com- 
pared and relevant conclusions presented. All raw data 
and analyzed products are available using the anonymous 
file transfer protocol (ftp): 

ftp . icess . ucsb . edu 
cd pub/bbop/DARR-94/ data 

or from the SeaWiFS Project Office data system (Hooker 
et al. 1994). 

Since the scope of this first data analysis intercompar- 
ison study (DARR-94) has been purposely limited, the 
present results will obviously have several inherent limi- 
tations: 

1. The methods are compared for a limited amount of 
data (9 casts) over a small range of environmental 
conditions. These data are for the mostly Case- 
1 waters (Table 2) and will not cover all possible 
observational scenarios. 

2. It is not known which method (if any) is providing 
the right answer as these are field data sets. Clearly, 
if all four methods coincide, the differences amongst 
the methods applied can be assumed unimportant; 
however if their results diverge, it remains unclear 
which method is right and which is wrong. 

3. A variety of correction procedures, which may be 
important for accurately determining AOPs, were 
not evaluated. These include corrections for Ra- 
man emissions, instrument self-shading, gimballing 
(or not) of surface irradiance sensors, tilt correc- 
tions for underwater spectroradiometer signals, and 
propagating the L U (CF,A) and E d (0~ , A) through 
the air-sea interface. All of these corrections may 
be important although they are not assessed here 
in an effort to simplify the goals of the DARR. It is 
likely that these corrections will be examined, along 
with a more extensive data set, in future DARR 
workshops. The use of synthetic data sets may also 
prove to be useful. 

It should be stressed that the goal of the DARR-94 
workshop was not to codify a single recipe by which data 
must be processed for SeaWiFS calibration and validation 
needs. This recipe is unknown and there are many factors, 
involving instrumentation, data acquisition, at-sea deploy- 
ment procedures, and the analysis goals of the investiga- 
tion, which make it difficult to provide a simple recipe for 
all investigators and all applications. That task is clearly 
beyond a three-day workshop. Nonetheless, an attempt 
is made to make generalities concerning what should and 
should not be done in analyzing spectroradiometry profiles. 
Furthermore, the conclusion is reached that the determina- 
tion of AOPs should be cast as a stochastic problem where 
statistical estimates are made with assessible confidence 
limits. This approach is critical for achieving SeaWiFS 
calibration and validation goals. 
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1.2 DATA ANALYSIS METHODS 

The present objective is to assess the differences among 
four different data analysis methodologies when applied 
to identical spectroradiometry data. All of the methods 
are presently used in the field and will be utilized by the 
CVT (McClain et al. 1992). Complete descriptions for each 
data analysis method are presented in subsequent chap- 
ters. Here, only a brief introduction of each method is 
presented. It should be mentioned that code (both source 
and executable) for most of the data analysis methods are 
available via anonymous ftp (see the authors of the indi- 
vidual chapters involved). 

The four methods have been developed with very differ- 
ent design objectives which are primarily specified by the 
science goals and logistical limitations of each group's at- 
sea sampling programs (Table 1). For example, the method 
employed by the BBOP (Chapter 2) has been designed to 
deal with large volumes of data (as many as 70 casts from a 
single day and over 2,000 casts a year). The design philoso- 
phy is that bad data are flagged and discarded rather than 
corrected. On the other hand, investigators at CHORS 
have developed an integral method for determining AOPs 
with the ability to hand select spurious data points. This 
design goal is predicated by inherent wire-time limitations 
due to large multidisciplinary cruises in which the CHORS 
group participates. These design goals reflect the at-sea 
sampling opportunities available to each group. The data 
analysis methods are each group’s solution to these prob- 
lems while optimizing their science objectives. 

The BBOP group has developed a data analysis method 
with the data analysis philosophy that they will take more 
casts than they need (Chapter 2, Sorensen et al. 1994, 
Siegel et al. 1995a, and Siegel et al. 1995b). This means 
suspect data will be eliminated from future consideration 
rather than corrected. Thus, the BBOP data processing 
system produces quality flags and is able to routinely han- 
dle large volumes of data, which requires that nearly all 
of the processing steps be completed with little human in- 
tervention. The suspect data condition is determined by 
evaluating a variety of predetermined quality flags (stabil- 
ity of incident irradiance levels, tilt and roll limitations, 
etc.) as well as the calculation of statistical confidence 
limits for most derived products. Relevant to the present 
intercomparison study, the BBOP data processing system 
estimates the values of L u (0“,A) and Ed{ 0“,A) by fitting 
a straight line to the upper 20 meters of a profile (10 m 
for A > 600 nm). The vertical profile of Kd(z, A) is deter- 
mined using a differential method where least-square fits 
are applied over 10 m vertical intervals. Robust curve fit- 
ting algorithms are used to reduce the effects of spurious 
data points or outliers (Press et al. 1992); also, confidence 
intervals for estimates of L u (0~,A) and £d(0“>^) are de- 
termined. The BBOP processing system runs on UNIX 
workstation computers and requires a GNU C++ compiler 
and a GUI package, such as Matlab or Interactive Data 


Language (IDL). For more information concerning acquir- 
ing the BBOP system see Chapter 2 or Siegel et al. (1995b). 

The CHORS group has taken a very different approach 
and has developed an integral method for determining the 
slope of the log-transformed irradiance profile, Kd(z, A), 
and its intercepts, L u (0",A) and Ed{ 0“,A) (Chapter 3). 
Their analysis goals are driven by the fact that they must 
make good estimates of AOPs from every cast in order to 
meet their own, as well as their colleagues’, scientific ob- 
jectives. The CHORS method determines the profile of 
Kd{z, A) and values of L u (0~,A) and £^(0~,A) simulta- 
neously using an integral method by fitting the radiation 
profile using low-order polynomials between user-selected 
node locations. The node locations may be determined ini- 
tially by examining a companion chlorophyll fluorescence 
profile, or if one is not present, by examination of curvature 
in the radiometric profile. The number and depths of nodes 
are then iteratively adjusted to minimize systematic depar- 
tures between the modeled and measured profile curves. 
Values of Kd{z , A) are determined analytically from the 
fitted polynomials. The CHORS method utilizes human- 
selected data rejection and node setting, and is developed 
with a sophisticated GUI. It should be noted that the de- 
termination of the L u ( 0“ , A) and Ed{0 ~ , A) values strongly 
affect the fit to the entire profile. The CHORS method 
presently runs on Silicon Graphics Inc. (SGI) workstations 
under IRIX 4.0 and higher. 

The NRL method (Chapter 4) has been developed with 
the same analysis goal as the CHORS method; namely, the 
need to make accurate determinations of AOPs from every 
cast during a cruise to achieve the science goals. NRL has 
employed a multiple level, prediction-correction procedure 
for estimating AOPs. The first level utilizes a differen- 
tial approach to make first order estimates of AOPs and is 
fully automated. The second level employs a series of cor- 
rection procedures and modeling to affect a robust surface 
normalization evaluating the 2 = 0“ and 2 = 0+ difference 
in an interactive mode through a sophisticated GUI. This 
surface normalization is done in order to eliminate the ef- 
fects of changing solar illumination due to clouds, as well 
as a correction procedure for the potential effects of ship 
shadowing and hull reflection. The second level method 
is not used for the DARR-94 comparisons as many of the 
data sets used were missing required data types. The NRL 
method works on UNIX workstations using the IDL soft- 
ware package. 

The SIO group has employed a bulk method for de- 
riving AOPs from spectroradiometry profiles (Chapter 5). 
The bulk approach has been long employed in the past and 
much of what is known about AOPs has come from using 
this approach (e.g., Strickland 1958, Tyler and Smith 1970, 
Smith and Baker 1978a and 1978b, and Morel 1988). The 
bulk method has been used in the past by the SIO group 
(e.g., Mitchell and Holm-Hansen 1991), although, they are 
not doing so presently. The bulk approach fits a straight 


6 



Siegel, O’Brien, Sorensen, Konnoff, Brody, Mueller, Davis, Rhea, and Hooker 


Table 2. Geolocation and sky conditions for data files compared in DARR-94. 


Group File 

Priority 

Location Station 

Longi tude Latitude 

Sky 

BBOP a010992b.dn 

1 

Sargasso BATS 

64° 44.20 W 31°23.61N 

Haze 

a061792f .dn 

1 

Sargasso BATS 

64 18.24 31 30.40 

8/8 Stratus 

a082092c .dn 

1 

Sargasso BATS 

64 7.84 31 50.99 

2/8 Cumulus 

CHORS 04111945. dn 

2 

GOMEX 611 

89 59.88 28 30.12 

Clear 

04111700. dn 

2 

GOMEX 510 

90 0.00 28 45.12 

Clear 

04141407. dn 

1 

GOMEX 1625 

89 27.48 28 30.48 

Patchy Clouds 

NRL e920328a.dn 

1 

EqPac 5 

139 57.90 0 1.80 

Overcast 

e921016a . dn 

1 

EqPac 5 

140 2.09 0 1.69 

Clear 

SIO c0403d.up 

1 

CalCoFI 

122 40.40 31 5.30 


c0411g.up 

2 

CalCoFI 

121 10.30 34 7.30 



Table 3. Temporal and in- water parameters for files compared in DARR-94. The maximum depth of the profile 
is given by z max and the mixed layer depth by z m id- 


Group 

File 

Priority 

Date 

Local Time 

^max 

^mld 

Notes 

BBOP 

aO 10992b. dn 

1 

9 Jan 92 

1600 

200 m 

100 m 

Late afternoon (sunset). 


a061792f .dn 

1 

17 Jun 92 

1000 

200 

20 



a082092c . dn 

1 

20 Aug 92 

1100 

200 

30 

Clear overhead. 

CHORS 

04111945. dn 

2 

11 Apr 93 

1345 

80 


Surface and bottom nephels. 


04111700. dn 

2 

11 Apr 93 

1100 

30 


Dark at 22m (K ^ 1.4m -1 ). 


04141407. dn 

1 

14 Apr 93 

0800 

200 


Deep water, clouds. 

NRL 

e920328a.dn 

1 

16 Oct 92 

1000 

180 

90 

Variable overcast. 


e921016a. dn 

1 

28 Mar 92 

1000 

200 

70 

Ship shadow? 

SIO 

c0403d .up 

1 

3 Apr 93 

0928 

200 

60 

Ship shadow, no surface. 


c0411g .up 

2 

11 Apr 93 

1325 

200 

10 

Good data to 30 m. 


line to the log-transformed irradiance and radiance pro- 
files within the oceanic mixed layer. The fluxes just below 
the sea surface are estimated from the exponentiated in- 
tercept and the slope gives a mixed layer averaged diffuse 
attenuation coefficient, Kd{zo, A). Obviously, only a single 
estimate of Kd{zo,\) is provided by this method; hence, 
it cannot be used to determine the depth dependence of 
Kd{z, A). The bulk method is included in the DARR-94 as 
an experimental control providing a single analysis from 
which one can interpret differences among the other meth- 
ods. One distinct advantage of the bulk method is that it 
can easily be applied using any spreadsheet program on a 
PC. 

There are significant differences among the four data 
analysis methods due to differing scientific objectives and 
at-sea logistics of the individual research groups. For the 
most part, differences among the data analysis methods 
are due to the way each group collects data at sea. The 
sampling philosophy for BBOP is based upon the under- 
standing that not every cast will produce good AOPs. The 
CHORS and NRL groups must be able to interact with 
other researchers on synoptic survey cruises and, hence, 
must determine AOPs for every daytime cast made. Thus, 
the CHORS and NRL groups have developed extensive sur- 
face normalization and correction procedures. The BBOP 
method assumes bad data can never be made into good 


data and, therefore, rejects AOP determinations based 
upon quality flags and the size of confidence intervals. The 
bulk method (SIO) completes the methods evaluated and 
is presented in a historical context from which an evalua- 
tion of the degree of improvement made by the other more 
sophisticated data analysis methods can be made. 

1.3 DATA AND RESULTS 
1.3.1 The DARR-94 Data Set 

A summary of the spectroradiometry data files and 
basic environmental conditions for these files used in the 
DARR-94 is shown in Tables 2 and 3. The files are la- 
beled with a priority number of 1 or 2 based upon whether 
these profiles provide adequate light data deep in the sam- 
pled water column. In some sense, priority 1 casts corre- 
spond to open ocean conditions in that the good data are 
found throughout the vertical profile and no anomalous 
features are observed, i.e., extremely high Kd(z,\) values, 
nepheloid layers, etc. Using this criteria, there are seven 
priority 1 profiles from which comparisons of data analy- 
sis methods are made. The priority 2 data appear to be 
mostly Case-2 water casts; hence, the primary comparisons 
made using the DARR-94 data set will be valid primarily 
for open ocean conditions using the priority 1 data set. 
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Results of the SeaWiFS Data Analysis Round-Robin, July 1994 (DARR-94) 


Unprocessed vertical profiles of £^( 2 , 488), L u (z, 488), 
Ed{ 0 + , 488), temperature, and in situ chlorophyll fluores- 
cence used in DARR-94 are shown in Figs. 1-10. Note 
that not all of parameters are sampled for each cast. In 
particular, there are no temperature or chlorophyll fluo- 
rescence data for the CHORS casts (CHORS 04111945, 
04111700, and 04141407) nor are there surface radiation 
measurements made with the SIO data set (c 0403d and 
c0411g; the CHORS analysis was applied assuming the in- 
cident ir radiance was constant). It must be stressed that 
the data provided here are not the best data collected by 
the contributing research group, but rather the data rep- 
resent typical data collected from the field. Indeed, some 
casts were selected to demonstrate how data analysis meth- 
ods deal with bad data. Obviously, bad casts are not useful 
for making AOP determinations for SeaWiFS calibration 
and validation purposes. 

It is apparent that there is a wide range of profile shapes 
in the aggregate DARR-94 data set. Water columns with 
deep chlorophyll maxima are found (BBOP a061792f and 
a082092c, NRL e921016a, and SIO c0403d) where the 
depth of chlorophyll fluorescence maximum varies from ap- 
proximately 50 m (NRL e921016a) to more than 125 m 
(BBOP a082092c). Casts with high chlorophyll values in 
the near surface layer are also found (BBOP aO 10992b, 
NRL e920328a, and SIO c0411g). It is obviously diffi- 
cult to make this determination from the CHORS data as 
there are no chlorophyll fluorescence data. Also, mixed 
layer depths of the DARR-94 data files vary from 10 to 
more than 100 m (Table 3). For the most part, the pro- 
files are taken under excellent incident illumination condi- 
tions. The obvious exceptions are the low light conditions 
of BBOP a010992b, which was taken at sunset, and the ex- 
treme incident irradiance variability found in the CHORS 
04141407 cast. Again, these distinctions cannot be made 
using the SIO casts, since incident irradiance is not in- 
cluded in the data; hence, a wide range of conditions are 
represented by the DARR-94 data set, although they are 
by no means inclusive. 

The upper 30 m of the downwelling irradiance, Ed(z, A), 
and upwelling radiance, £ u (z, A) profiles are of particular 
relevance for assessing AOPs for SeaWiFS calibration and 
validation purposes (Figs. 1-10). Within this depth re- 
gion, the intercept values, £ u (0" , A) and £^(0“ , A), are de- 
termined using a statistical method (such as least-squares 
estimation). If stable values of L u (0 , A) and £^(0”, A) are 
to be retrieved, the log-transformed Ed{z, A) and £ u (z,A) 
profiles must be found along a straight line. The raw 
Ed(z,\) find £ u (z,A) profiles show a significant degree of 
variation off this assumed straight line (Figs. 1-10). Fur- 
thermore, the variance about a straight line appears to 
increase as the sea surface is approached and is greater for 
Ed(z, A) than for L u (z, A). There are a variety of causes 
for these variations, including, ship shadow and hull re- 
flection, surface gravity wave-induced glint and focusing, 
random tilting of the profiling spectroradiometer off zenith, 


as well as cloud-induced fluctuations of the incident irra- 
diance (which may affect a profile of light at any depth). 

Large near-surface radiation variations in radiometric 
profiles may also result from strong, vertically stratified 
region of increased attenuation by particles and dissolved 
materials in the water column. In the CHORS 04111945 
cast, for example, both the Ed(z, A) and L u {z y A) profiles 
show a strongly nonlinear decrease with depth over the 
top 5 m. This profile was taken near the Mississippi River 
outflow, and the highly turbid surface lay responsible for 
large values of Kd{z, A) for both Ed(z y A) and L u (z, A) are 
of Mississippi River origin. However for most of the other 
casts, the high degree of near-surface Ed{z, A) and L u (z, A) 
variations is not due to changes in optical water masses, 
but rather to random sources of irradiance noise within the 
profile. Ship-induced sources of noise (i.e., ship shadows) 
are apparent in some of the profiles (cf., NRL e 92 10 16a 
and SIO c0403d). Note that for the BBOP data, the ship 
shadow signal has been shown to be smaller than other 
inherent sources of noise in the estimation of AOPs (Weir 
et al. 1994). 

1.3.2 Near-Surface Data Comparisons 

Central to the agreed upon goals of DARR-94 was the 
comparison of estimates of the downwelling irradiance and 
the upwelling radiance spectra just beneath the sea surface 
(z = 0“), £^(0~,A) and £ U (0~,A) respectively. Estimates 
of £^(0~,A) and L u (0~,\) for the four individual analy- 
ses of the priority 1 data set and their aggregate statistics 
are presented in Figs. 11-17. A casual examination of the 
Ed( 0“,A) and £ U (0“,A) estimates illustrates several gen- 
eralities concerning the abilities to make accurate determi- 
nations of Ed(0~ , A) and £ u (0~ , A) from spectroradiometry 
profiles: 

1. The variations among the various methods is 
greater for Ed(0~ y A) than for L u ( 0", A). 

2. This difference is accentuated in the red wave- 
lengths. 

3. The spread among the individual Ed( 0 - ,A) es- 
timates is mostly smaller than the size of the 
95% confidence interval for the BBOP estimate; 
although, at times, there are exceptions (BBOP 
a010992b). 

4. The simple least-squares methods employed by 
the SIO group appears to be the onle one of the 
four methods that consistently produces outlier 
estimates of £^(0 - ,A) and L u (0“,A). This is 
particularly apparent in the red wavelengths. 

5. The spread among the differing £^(0~,A) and 
£u(0",A) estimates does not appear to be re- 
lated to the clarity of the water as inferred by 
the estimated color, L u ( 0~, A). 
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bbop.a0 1 0992 b. led. down 



bbop.aO 10992b. ted. down 



16.0 16.5 17.0 17.5 18.0 18.5 

2ed488 


bbop.a0 1 09 9 2b. led. down bbop.aOl 0992b. led. down 




Hemp Ifluor 


Fig. 1 . Vertical profiles of the raw data used in the DARR-94 comparison for BBOP aO 10992b. The four 
panels for each vertical distribution are assembled: a) downwelling irradiance at 488 nm and upwelling radiance 
at 488 nm, Ed{z, 488) (in units of mWcm _2 nm _1 ) and L u (z, 488) (mWcm" 2 nm" 1 sr' 1 ), respectively; b) 
the incident irradiance at 488 nm during the time of the cast, £d(0 + ,488); c) in situ temperature (°C); and 
d) chlorophyll fluorescence (in volts). 
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bbop.a061 792f. led. down bbop.a061 792f. led. down 



1ed488 2ed488 


bbop.a061 79 2 f .led. down bbop.a06 1 792f. led. down 



18 19 20 21 22 23 24 0.0 0.2 0.4 0.6 0.8 1.0 

Itemp Ifluor 


Fig. 2. Vertical profiles of the raw data used in the DARR-94 comparison for BBOP a061792f . The four 
panels for each vertical distribution are assembled: a) downwelling irradiance at 488 nm and upwelling radiance 
at 488 nm, Ed{z, 488) (in units of mWcm" 2 nm _1 ) and L u (z, 488) (mWcm -2 nm -1 sr -1 ), respectively; b) 
the incident irradiance at 488 nm during the time of the cast, £*d(0 + ,488); c) in situ temperature (°C); and 
d) chlorophyll fluorescence (in volts). 
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Fig. 3. Vertical profiles of the raw data used in the DARR-94 comparison for BBOP a082092c. The four 
panels for each vertical distribution are assembled: a) downwelling irradiance at 488 nm and upwelling radiance 
at 488 nm, E d (z, 488) (in units of mWcm^nm' 1 ) and L u (r,488) (mWcm^nm -1 sr -1 ), respectively; b) 
the incident irradiance at 488 nm during the time of the cast, E d ( 0 + ,488); c) in situ temperature (°C); and 
d) chlorophyll fluorescence (in volts). 
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nrl.e920328a.lcd.down 




67.5 68.0 68.5 69.0 69.5 70.0 

Es520 


nrl.e9 20328a. led. down nrl.e920328a. led. down 




Fig. 4. Vertical profiles of the raw data used in the DARR-94 comparison for NRL e920328a. The four panels 
for each vertical distribution are assembled: a) downwelling irradiance at 488 nm and upwelling radiance at 
488 nm, E d (z, 488) (in units of mWcm“ 2 nm _1 ) and L u (z,488) (mWcm” 2 nm‘ x sr _1 ), respectively; b) the 
incident irradiance at 488 nm during the time of the cast, E d (0 + , 488); c) in situ temperature (°C); and d) 
chlorophyll fluorescence (in volts). 
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Fig. 5. Vertical profiles of the raw data used in the DARR-94 comparison for NRL e921016a. The four panels 
for each vertical distribution are assembled: a) downwelling irradiance at 488 nm and upwelling radiance at 
488 nm, Ed(z, 488) (in units of mWcm -2 nm -1 ) and L u (z, 488) (mWcm" 2 nm' 1 sr“ 1 ) 1 respectively; b) the 
incident irradiance at 488 nm during the time of the cast, £d(0 + , 488); c) in situ temperature (°C); and d) 
chlorophyll fluorescence (in volts). 
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sio.c041 1 g. led 
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sio.c04 1 1 g.lcd 



Fig. 7. Vertical profiles of the raw data used in the DARR-94 comparison for SIO c0411g. The three panels 
for each vertical distribution are assembled: a) downwelling irradiance at 488 nm and upwelling radiance at 
488 nm, E d (z, 488) (in units of raWcm^nm- 1 ) and L u {z, 488) (mWcm^nm-’sf 1 ), respectively; b) in 
situ temperature (°C); and c) chlorophyll fluorescence (in volts). 
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Fig. 8. Vertical profiles of the raw data used in the DARR-94 comparison for CHORS 04111700. The two 
panels for each vertical distribution are assembled: a) downwelling irradiance at 486 nm and upwelling radiance 
at 486 nm, £<*(2,486) (in units of mWcm -2 nm -1 ) and L u (z, 486) (mWcm" 2 nm“ 1 sr" 1 ) 1 respectively; b) 
the incident irradiance at 487 nm during the time of the cast, E s (0 + , 487). 
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Fig. 9. Vertical profiles of the raw data used in the DARR-94 comparison for CHORS 04111945. The two 
panels for each vertical distribution are assembled: a) downwelling irradiance at 486 nm and upwelling radiance 
at 486 nm, £<*(2,486) (in units of mWcm" 2 nm _1 ) and L u (z, 486) (mWcm" 2 nm" 1 sr" 1 ), respectively; b) 
the incident irradiance at 487 nm during the time of the cast, £ a (0 4 ',487). 
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Fig. 10. Vertical profiles of the raw data used in the DARR-94 comparison for CHORS 04141407. Ihe two 
panels for each vertical distribution are assembled: a) downwelling irradiance at 486 nm and upwelling radiance 
at 486 nm, E d (z, 486) (in units of mWcm“ 2 nm" 1 ) and L u (z, 486)(mWcm~ 2 nm" 1 sr' 1 ), respectively; b) the 
incident irradiance at 487 nm during the time of the cast, £ s (0 + ,487). 


A quantitative evaluation of the differing £<*(0“ , A) and 
L u (0“,A) estimates may be made by examining the coef- 
ficient of variation (c.v.) among the four analyses for each 
priority 1 cast. Values of c.v. (in percentages) for the pri- 
ority 1 DARR-94 casts are shown in Table 4. Only overlap- 
ping wavebands are shown in Table 4 (where L u ( 0” , 530) is 
substituted for L u (0“,520) in the CHORS data). Typical 
c.v. values range from about 1-8%. When all of the prior- 
ity 1 data are evaluated, mean c.v. values are slightly lower 
for E d (0~ , A) estimates than they are for L u (0“, A). Of the 
individual casts, the CHORS data file 04141407 is by far 
the worst of the priority 1 casts, especially for L u (0~, A). 
This is expected as this cast had extensive cloud-induced 
incident irradiance variations (Fig. 10). When this cast is 
removed from consideration (the EC values in Table 4), 
the DARR-94 mean c.v. values are around 3-4% with no 
significant difference between the L u (0~,A) and £d(0~, A) 
estimates; hence, the scatter of the results of the four anal- 
yses about the analysis aggregate mean for good casts is 
less than 4% of the retrieved value. 

The comparison of the relative size of the 95% con- 
fidence intervals for the BBOP determined £<f(0“,A) and 
L u (0-,A) provides another objective measure of the degree 


to AOPs can be accurately determined. Here, the relative 
uncertainty in the least-squares estimation of £<*(0 , A) 
and L u (0“,A) is presented in Table 5 as the ratio of the 
confidence interval to the retrieved value. In general, the 
relative uncertainty in L u ( 0~, A) is much smaller than it is 
for £d(0",A) (with the obvious exception of the CHORS 
04141407 cast). Excluding this one bad cast, the rela- 
tive uncertainty is approximately 2% for L u (0~,A) and 
about 7% for E d ( 0”,A). Some casts (BBOP a061792f 
and a082092c, and SIO c0403d) result in very large val- 
ues (greater than or equal to 8%) of relative uncertainty for 
£d(0~,A). This is due to the high degree of variability in 
the near-surface E d (z i A) profile for these casts (Figs. 2, 3, 
and 6). The L u ( 0~,A) estimates have significantly lower 
relative uncertainties for these casts suggesting that the 
source of error may be due to surface gravity wave-induced 
irradiance fluctuations (see below). 

Comparison of the K d (z, A) estimates are shown in 
Figs. 18-26. In general, the comparison looks very good 
for most of the casts where normalized root mean square 
(rms) deviations among the four analyses are typically less 
than 5%. If anything, the normalized rms deviations are 
smaller for the higher wavelengths (A > 550 nm), which 
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04141407 04141407 





Legend 


□ BBOP 

O CHORS o NRL 

A SIO 


Fig. 11. Estimates of a) the downwelling irradiance just beneath the sea surface, Ed{ O', A), and b) the 
upwelling radiance just beneath the sea surface, L u ( 0", A) for CHORS 04141407. In the upper panels, all 
four of the individual analyses are shown. The error bars in the upper panels correspond to the 95% confidence 
intervals for the BBOP extrapolations for Ed(0 ~ , A) and L u (0 ~ , A) and are shown in each of the upper panels. 
The lower panels show the mean of the four analyses and the error bars represent the standard deviation 
about the mean for each waveband. Only priority 1 casts are shown. Confidence intervals are not calculated 
as the sample size (N = 4) is very small. 
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Fig. 12. Estimates of a) the downwelling irradiance just beneath the sea surface, 2^(0", A), and b) the 
upwelling radiance just beneath the sea surface, L u (0”, A) for BBOP a010992b. In the upper panels, all four 
of the individual analyses are shown; the lower panels show the mean of the four analyses. The error bars 
for the upper and lower panels are the same as those indicated in Fig. 11. Only priority 1 casts are shown. 
Confidence intervals are not calculated as the sample size (N = 4) is very small. 
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a061 792f.lcd.1 a061 792f.lcd.1 



Fig. 13. Estimates of a) the downwelling irradiance just beneath the sea surface, Ej(0~,A), and b) the 
upwelling radiance just beneath the sea surface, L u ( 0",A) for BBOP a061792f. In the upper panels, all four 
of the individual analyses are shown; the lower panels show the mean of the four analyses. The error bars 
for the upper and lower panels are the same as those indicated in Fig. 11. Only priority 1 casts are shown. 
Confidence intervals are not calculated as the sample size ( N = 4) is very small. 
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Fig. 14. Estimates of a) the downwelling irradiance just beneath the sea surface, Ed{ 0~,A), and b) the 
upweiling radiance just beneath the sea surface, L u ( 0~, A) for BBOP a082092c. In the upper panels, all four 
of the individual analyses are shown; the lower panels show the mean of the four analyses. The error bars 
for the upper and lower panels are the same as those indicated in Fig. 11. Only priority 1 casts are shown. 
Confidence intervals are not calculated as the sample size (N = 4) is very small. 
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c0403d c0403d 



Fig. 15. Estimates of a) the downwelling irradiance just beneath the sea surface, £ d ( 0~,A), and b) the 
upweliing radiance just beneath the sea surface, L u (0~, A) for SIO c0403d. In the upper panels, all four of 
the individual analyses are shown; the lower panels show the mean of the four analyses. The error bars for 
the upper and lower panels are the same as those indicated in Fig. 11. Only priority 1 casts are shown. 
Confidence intervals are not calculated as the sample size (N ~ 4) is very small. 
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Fig. 16. Estimates of a) the downwelling irradiance just beneath the sea surface, E<i( 0“,A), and b) the 
upwelling radiance just beneath the sea surface, L u (0~, A) for NRL e920328a. In the upper panels, all four 
of the individual analyses are shown; the lower panels show the mean of the four analyses. The error bars 
for the upper and lower panels are the same as those indicated in Fig. 11. Only priority 1 casts are shown. 
Confidence intervals are not calculated as the sample size (N = 4) is very small. 
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Fig* 17 . Estimates of a) the downwelling irradiance just beneath the sea surface, £^(0~,A), and b) the 
upwelling radiance just beneath the sea surface, L u (0~, A) for NRL e921016a. In the upper panels, all four 
of the individual analyses are shown; the lower panels show the mean of the four analyses. The error bars 
for the upper and lower panels are the same as those indicated in Fig. 11. Only priority 1 casts are shown. 
Confidence intervals are not calculated as the sample size (TV — 4) is very small. 
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Tkble 4. Coefficients of variation (in percentage) among the four analyses for estimates of E d ( 0 ,A) and 
L u (0~ , A) from the priority 1 casts. Data are given only where there are overlapping wavebands. Data set mean 
and standard deviation EC values in the last two lines exclude the spurious CHORS cast. 


Group 

Cast 

E d ( 0-.441) 

-MO-,490) 

Ed (0’, 520) 

L u (0-,441) 

L u (0-,490) 

Z/ u (0“, 520) 

BBOP 

a010992b 

7.02 

6.20 

7.17 

8.84 

8.91 

8.24 


a061792f 

4.41 

4.02 

4.12 

2.65 

2.33 

7.97 


a082092c 

3.85 

3.47 

3.32 

3.98 

3.83 

2.57 

CHORS 

04141407 

4.41 

9.41 

4.69 

19.89 

27.52 

22.30 

NRL 

e920328a 

0.58 

0.80 

3.30 

2.00 

1.59 

2.00 


e921016a 

2.09 

2.63 

1.99 

1.75 

1.78 

2.05 

SIO 

c0403d 

1.43 

1.59 

1.18 

2.20 

1.54 

1.49 


Mean 

3.40 

4.02 

3.68 

5.90 

6.79 

6.66 

Standard Deviation 

2.19 

2.95 

1.95 

6.64 

9.51 

7.47 


EC Mean 

3.23 

3.12 

3.51 

3.57 

3.33 

4.05 

EC Standard Deviation 

2.35 

1.92 

2.08 

2.70 

2.86 

3.16 


Table 5. Ratio of the BBOP-analyzed 95% confidence estimates for E d (0 , A) and L u ( 0 , A) to the estimated 
value (in percentage) for the priority 1 DARR-94 casts. EC values in the last two lines correspond to statistical 
values excluding the CHORS data. - 


Group 

Cast 

£ d (0-,441) 

£d(0-,490) 

-Ed (0", 520) 

Lu(0-,441) 

L u (0~,490) 

L u (0-,520) 

BBOP 

a010992b 

2.16 

2.11 

2.27 

2.16 

2.03 

2.56 


a061792f 1 

8.75 

8.97 

9.74 

1.52 

1.11 

0.64 


a082092c 

16.60 

17.40 

16.70 

1.62 

1.84 

3.10 

CHORS 

04141407 

16.80 

19.70 

21.20 

18.90 

21.60 

19.40 

NRL 

e920328a 

5.69 

6.11 

6.46 

1.43 

1.57 

1.96 


e921016a 

0.99 

0.99 

1.16 

0.98 

1.43 

3.94 

SIO 

c0403d 

8.18 

8.28 

8.64 

3.42 

3.42 

3.65 


Mean 

8.45 

9.08 

9.45 

4.29 

4.71 

5.04 

Standard Deviation 

6.31 

7.14 

7.31 

6.49 

7.48 

6.43 


EC Mean 

7.06 

7.31 

7.50 

1.86 

1.90 

2.64 

EC Standard Deviation 

5.62 

5.90 

5.65 

0.86 

0.81 

1.22 


is due to the fact that the values of K d (z, A) are much 
larger for these wavebands. The tracking of the results 
of the three depth-varying methods (CHORS, BBOP, and 
NRL) is encouraging. Since the CHORS method is an in- 
tegral method, its K d (z, A) profiles are smoother and for 
many of the DARR-94 profiles it seems to do an excel- 
lent job. However, it may not reproduce all the real high 
wavenumber variations in K d (z, A) as the other methods 
do. 

The largest deviations among the methods occur for 
those casts that are affected by cloud-induced variations of 
the incident flux (CHORS 04141407), obvious ship shad- 
ows (NRL e921016a and SIO c0403d) or what appear to 
be surface wave induced variations (BBOP a082092c). In- 
dications of the noise sources are apparent via the pat- 
tern of the K d {z,\) variations with depth. For exam- 
ple, the CHORS 04141407 cast has large random- looking 
variations in the derived K d (z y \) values for the BBOP 
and NRL (differential analyses). The CHORS analyzed 


K d (z, A) profile seems to fall in the middle in the scatter 
between the other two noisy K d (z, A) profiles. It should 
be mentioned that this particular cast has an extensive 
amount of incident irradiance noise and is flagged as unac- 
ceptable by the BBOP analysis. The NRL e921016a data 
shows a single wiggle in the K d (z , A) profile at about 30 m 
which is likely due to a ship shadow since there are little 
significant short-time scale variations in the incident flux 
during this profile (Fig. 5). The BBOP cast with large 
rms deviations among analyses (BBOP a082092c) seems 
to show a regular pattern with depth. 

The bulk method for K d (z, A) (SIO) provides only a 
single point, which is representative of the mixed layer. 
In general, its retrieved value is consistent with the more 
sophisticated analyses and there are no apparent biases in 
the bulk methods K d {z Qi X) value and the results of the 
other analyses. It is obvious that the bulk method cannot 
produce data appropriate for assessing the vertical profile 
of K d (z, A). 
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bbop.010992b.dn 






Fig. 18. Vertical profiles of Kd(z, A) for downwelling irradiance from BBOP 010992b, and the normalized 
rms deviation for the four DARR-94 analyses in the a) blue, b) blue-green, c) green-yellow, and d) red 
spectral regions. Normalized rms deviations are calculated over 20 m intervals. The four individual analyses 
are shown as plus signs (+) for BBOP, dots (.) for CHORS, diamonds (o) for NRL, and triangles (A) for SIO. 
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bbop.061792f.dn 






Fig. 19 . Vertical profiles of Kd{z, A) for downwelling irradiance from BBOP 061792f, and the normalized 
rms deviation for the four DARR-94 analyses in the a) blue, b) blue-green, c) green-yellow, and d) red 
spectral regions. Normalized rms deviations are calculated over 20 m intervals. The four individual analyses 
are shown as plus signs (+) for BBOP, dots (•) for CHORS, diamonds (o) for NRL, and triangles (A) for SIO. 
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Fig. 20. Vertical profiles of Kd(z, A) for downwelling irradiance from BBOP a082092c, and the normalized 
rms deviation for the four DARR-94 analyses in the a) blue, b) blue-green, c) green- yellow, and d) red 
spectral regions. Normalized rms deviations are calculated over 20 m intervals. The four individual analyses 
are shown as plus signs (+) for BBOP, dots (•) for CHORS, diamonds (o) for NRL, and triangles (a) for SIO. 
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Fig. 21. Vertical profiles of Kd(z, A) for downwelling irradiance from CHORS 04111945, and the normalized 
rms deviation for the four DARR-94 analyses in the a) blue, b) blue-green, c) green-yellow, and d) red 
spectral regions. Normalized rms deviations are calculated over 20 m intervals. The four individual analyses 
are shown as plus signs (+) for BBOP, dots (•) for CHORS, diamonds (o) for NRL, and triangles (A) for SIO. 
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Fig. 22. Vertical profiles of Kd{z , A) for downwelling irradiance from CHORS 04141407, and the normalized 
rms deviation for the four DARR-94 analyses in the a) blue, b) blue-green, c) green-yellow, and d) red 
spectral regions. Normalized rms deviations are calculated over 20 m intervals. The four individual analyses 
are shown as plus signs (+) for BBOP, dots (•) for CHORS, diamonds (o) for NRL, and triangles (a) for SIO. 
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Fig. 23 . Vertical profiles of Kd{z, A) for downwelling irradiance from NRL ©920328a, and the normalized rms 
deviation for the four DARR-94 analyses in the a) blue, b) blue-green, c) green- yellow, and d) red spectral 
regions. Normalized rms deviations are calculated over 20 m intervals. The four individual analyses are shown 
as plus signs (+) for BBOP, dots (•) for CHORS, diamonds (o) for NRL, and triangles (a) for SIO. 
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Fig. 24. Vertical profiles of K d (z, \) for downwelling irradiance from NRL e921016a, and the normalized rms 
deviation for the four DARR-94 analyses in the a) blue, b) blue-green, c) green-yellow, and d) red spectral 
regions. Normalized rms deviations are calculated over 20 m intervals. The four individual analyses are shown 
as plus signs (+) for BBOP, dots (•) for CHORS, diamonds (o) for NRL, and triangles (A) for SIO. 
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Fig. 25. Vertical profiles of A) for downwelling irradiance from SIO 0403d, and the normalized rms 
deviation for the four DARR-94 analyses in the a) blue, b) blue-green, c) green-yellow, and d) red spectral 
regions. Normalized rms deviations are calculated over 20 m intervals. The four individual analyses are shown 
as plus signs (+) for BBOP, dots (•) for CHORS, diamonds (o) for NRL, and triangles (a) for SIO. 
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Fig. 26. Vertical profiles of Kd{z, A) for downwelling irradiance from SIO c0411g, and the normalized rms 
deviation for the four DARR-94 analyses in the a) blue, b) blue-green, c) green-yellow, and d) red spectral 
regions. Normalized rms deviations are calculated over 20 m intervals. The four individual analyses are shown 
as plus signs (+) for BBOP, dots (•) for CHORS, diamonds (o) for NRL, and triangles (a) for SIO. 
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1.4 DISCUSSION 

The possible cause of deviation among the differing 
£’rf(0~ , A) and Kd{z, A) estimates can be bet- 
ter understood by considering how a profiling spectrora- 
diometer samples a time-varying sea and how values of 
£u(0 _ >A) and Ed(0~,X) are determined. Specifically, a 
profiling spectroradiometer samples both in time and depth 
as it is lowered through the water column. If there are 
sources of in situ radiation variability with time scales at, 
or less than, the time required to sample the upper 20 or so 
meters of the water column, these variations will be super- 
imposed upon the time- mean signal whose properties are 
being assessed. The different analysis methods presented 
here all smooth the data in different manners and evaluate 
Ed( 0”, A) and L u (0“, A) over different portions of the ver- 
tical profile and, therefore, will be evaluated over differing 
sampling times. This results in different values of retrieved 
AOPs as has been shown. 

Cloud-induced variations of the incident flux are an ob- 
vious source of noise in an irradiance profile, e.g., CHORS 
04141407. Fortunately, the presence or absence of cloud 
variations can be evaluated by simultaneously sampling the 
incident downwelling irradiance. Although time variations 
at depth may not exactly correspond with incident ones, 
the presence or absence of incident flux variations provides 
a measure of whether cloud-induced variations are impor- 
tant (see Figs. 1-10). With the exception of the CHORS 
04141407 cast, the priority 1 data set appears to be nearly 
free from this source of noise variability. The effect of inci- 
dent flux variations upon the Kd(z , A) estimates is obvious, 
even when attempts are made to normalize the underwa- 
ter with the surface fluxes (the CHORS analysis of the 
CHORS 04141407 cast in Fig. 22). 

A major source of Ed{z , A) variability near the sea sur- 
face is caused by surface gravity waves (e.g., Dera and Gor- 
don 1968, Snyder and Dera 1970, Siegel and Dickey 1988, 
and Stramski et al. 1992) . The tilting of the sea surface due 
to surface gravity wave motions results in quasi-random 
fluctuations in the in situ irradiance with time scales on 
the order of the wave period (cf., Gordon et al. 1971 and 
Siegel and Dickey 1988). An estimate of the effects of sur- 
face gravity waves upon a vertical profile of downwelling 
irradiance can be made by assuming a dominant swell pe- 
riod of 8 seconds and a package lowering rate of 0.5 ms -1 . 
In this example, the surface swell would produce a fluc- 
tuating component of irradiance with a vertical scale of 
approximately 4 m. This signal must be eliminated if ac- 
curate estimates of AOPs are to be made by determining 
the AOPs over some large vertical interval (on the order 
of 10-20 m). Differences in how this is accomplished will 
obviously result in differences in the retrieved AOPs. How- 
ever, this fact points to AOP estimation methods which 
eliminate (or de-emphasize) the effects of outliers off the 
time-mean irradiance profiles, e.g., Press et al. 1992. 


The observed differences between the uncertainties in 
the Ed( 0~,A) and L u (0 - ,A) estimates can also be recon- 
ciled if one considers the underwater radiance distribution 
near the sea surface, e.g., Smith 1974 and Voss 1989. Ne- 
glecting diffuse light for the moment, the downwelling pho- 
tons will be restricted to within a Fresnel cone (within 41° 
of zenith). The area of sea surface sampled by the radiome- 
ter increases dramatically with the depth of measurement. 
Near the sea surface, the extent of the sea surface inter- 
secting the sampling Fresnel cone is small and the effects of 
surface wave glint will be very important. As the depth of 
sampling is increased, however, the area of sea surface in- 
creases to include many glinting facets. This will effectively 
average out the effects of the randomly glinting sea surface 
elements on the sampled irradiance signal. Hence, the ef- 
fects of sea surface gravity waves will be most prominent on 
Ed(z, A) profiles near the sea surface which are being used 
to estimate values of £^(0“, A). Profiles of L u (z, A) will be 
smoother with respect to depth since upwelling radiance 
is backscattered downwelling light and, hence, has entered 
the sea over a considerably larger area than the Fresnel 
sampling cone for that depth. Therefore, the surface grav- 
ity wave noise will affect Ed{z, A) profiles to a much larger 
degree than L u (z, A). This can be seen qualitatively in the 
raw data distributions in Figs. 1-10 or in the relative un- 
certainty estimates of Table 5. This argument is similar to 
the ship shadow avoidance distance discussion presented 
in Mueller and Austin (1995). 

Quasi-random variations in the orientation of the spec- 
troradiometer package may also be an important factor in 
creating noise in Ed(z } A) and L u (z, A) profiles, particu- 
larly near the sea surface. In essence, random tilts can 
push the collection of Ed(z,\) into, and out of, the Fres- 
nel cone. This affects the L u (z, A) profile determination to 
a much lesser degree because of the more uniform angu- 
lar distribution of the upwelling radiance (Smith 1974 and 
Voss 1989). 

Ship shadows may also be an important factor, which 
will give rise to variations in the retrieved AOP values. In 
some sense, a ship shadow provides a time-mean pertur- 
bation to in situ radiation signals with a depth scale on 
the order of 10 m. This again will create differences in sea 
surface extrapolated fluxes if the data are handled in dif- 
ferent manners. There may also be a differential spectral 
response. Unfortunately, this effect cannot be objectively 
assessed using the present data set. 

The results of the DARR-94 workshop do not point to 
one analysis being better than another, but rather give 
indications of the inherent uncertainty of AOP estimation 
due to geophysical noise sources. The different analyses as- 
sess different parts of the profile and thus, different parts 
of the space-time distribution of the in situ radiation sig- 
nal. The different methods average, smooth, and perform 
curve fits on the raw data profiles in different ways. This 
strongly suggests the determination of AOPs from spectro- 
radiometry profiles should be posed as a statistical prob- 
lem. Statistically determined AOP estimates should have 
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associated confidence intervals. The size of the confidence 
intervals provides an objective measure of the goodness of 
the derived AOP estimate. Presently, only the BBOP data 
analysis method provides a measure of confidence for the 
estimate; although this is certainly not a criticism of the 
other analysis methods. 

This vision must be carried through in the analysis 
and utilization of spectroradiometry profiles. Generally, a 
statistical technique is employed to estimate AOP values, 
which will naturally provide an uncertainty estimate. This 
confidence estimate needs to be determined and used. In 
addition, the means to exploit AOP uncertainties in fur- 
ther analyses and interpretations needs to be developed. 
For example, a data point with a large uncertainty about 
its estimated value should have a smaller contribution to 
a global regression analysis than an estimate with a small 
uncertainty, e.g., Press et al. 1992. 

There are obvious extensions of this thinking to objec- 
tive mapping of satellite imagery, e.g., Santoreli et al. 1991. 
This use of confidence intervals may be most important 
when in situ AOP estimates are compared with satellite 
imagery, i.e., calibration and validation. When performing 
calibration and validation, a retrieved satellite- sensed pixel 
value, which has been corrected for the effects of the atmo- 
sphere, is compared with the estimated in situ AOP value. 
Both values will have a quantifiable degree of uncertainty 
associated with them; hence, the calibration and valida- 
tion problem should be restated formally as a statistical 
one. This uncertainty information is important and must 
be considered in future calibration and validation analyses. 
Researchers must now work to develop effective means to 
use these important pieces of information. 

1.5 CONCLUSIONS 

The bottom line result of the DARR-94 study is that, 
with good data, the spread among different data analysis 
methods for determining the upwelling radiance and down- 


welling irradiance just beneath the sea surface, L u (0~ , A) 
and Ed{ 0~,A), respectively, is about 3-4% of the analy- 
ses aggregate mean estimate. The statistical uncertainty 
in determinations of £*<*(0“ , A) are considerably larger (ap- 
proximately 7%) than those for L u (0”,A) (approximately 
2%), as found using the BBOP results. These differences 
can be attributed to geophysical noise sources in the raw 
data streams, which appear to be dominated by surface 
wave glinting processes. Furthermore, the profile of the 
diffuse attenuation coefficient spectrum, /Q(z, A), can be 
replicated to better than 5% with the differing analyses. 
These differences account for much of the total 5% uncer- 
tainty that is tolerated for SeaWiFS calibration and vali- 
dation purposes (Mueller and Austin 1995). For bad casts, 
much larger deviations among methods can occur. 

The DARR-94 results do not show a clear winner or 
loser among the three sophisticated data analysis methods. 
Some degree of outlier rejection is required to accurately 
estimate L u (0",A) or £d(0~,A). Whether this happens 
automatically (i.e., BBOP) or manually (i.e., CHORS or 
NRL) does not seem to matter. The bulk method, how- 
ever, is simply not adequate. Possible solutions include 
manual or automated data disqualification, robust curve 
fitting routines, or extrapolation using the incident flux 
(not fully evaluated here). Furthermore, the calculation, 
evaluation, and exploitation of confidence intervals for the 
AOP determinations need to be explored in more detail. 
This is critical for the long-term assessment of ocean color 
imagery and its calibration and validation using in situ 
data sets. 

Critical to the results presented here is the need for 
good data. There are no substitutes. Good at-sea pro- 
cedures are essential including the sampling of unaliased, 
continuous data sets. The SeaWiFS Project has spent a 
great deal of effort ensuring that this is the case (Mueller 
and Austin 1995) and recommends strongly that these 
guidelines be followed. 
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Chapter 2 


The BBOP Data Processing System 

Jens C. Sorensen, Margaret C. O’Brien, Daniel A. Konnoff, and 

David A. Siegel 

University of California , Santa Barbara , Santa Barbara , California 

Abstract 

The shear volume of profiling spectroradiometer data is increasing dramatically as global change research pro- 
grams are placing more emphasis on the evaluation of spatial and temporal structure of ocean biogeochemical 
cycles. For example, BBOP collects over 1,000 profiles each year in order to link time-series observations of 
primary production rates to bio-optical parameters. It is likely that these trends will continue as there are 
several satellite ocean color sensors that are planned to be deployed between now and the end of the century. 
However, these vast amounts of data must be calibrated, processed, reduced, analyzed, and interpreted in a 
timely manner. Here, a computer data processing system for efficiently achieving this goal is presented in terms 
of both computational and human resources. The processing system is comprised of a suite of ANSI C++ pro- 
grams that read and operate on a specified file format, the LCD data file. The LCD file contains all relevant 
data and metadata, which include calibration information and at-sea comments, in a single ASCII file. UNIX 
shell scripts are used in the control of data flow, as well as error and log handling. The final product is a binned 
spectroradiometer data set with relevant derived parameters included [Kd(z, A), R rs (z, A), Ed(0 ~ , A), etc.] that 
may be disseminated to other groups or databases. At UCSB, the BBOP system has been used for the past two 
years and the system is available for use by other research groups. 


2.1 INTRODUCTION 

It is well recognized that ocean optics data sets have 
a huge potential for addressing many aspects of ocean 
biogeo-chemical cycles (see for example, Dickey and Siegel 
1993). To be effectively used in interdisciplinary studies, 
such as JGOFS, optical data sets must be made available in 
a timely manner. For example, in order to effectively col- 
laborate with other investigators in the JGOFS BATS, the 
BBOP activity must provide and interpret ocean optical 
data sets on the same time scale as the BATS collabora- 
tors to work up pigment, primary production and water 
chemistry data. In addition, the calibration and valida- 
tion needs of the upcoming SeaWiFS ocean color mission 
requires processed ocean optics data in near-real time (Mc- 
Clain et &1. 1992). 

A major stumbling block in the dissemination and uti- 
lization of bio-optical data sets has been the lack of efficient 
and straightforward data processing schema. Bio-optical 
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data sets have several characteristics which make their 
final products difficult to produce quickly. First, they tend 
to be large (several Mbytes each) due to high data sam- 
pling rates and a diverse parameter range. Second, many 
profiles (tens to thousands) are often made during a single 
cruise due to experimental design and the at-sea ease of 
making these profiles. Recalculation of measured parame- 
ters is another characteristic of profiling spectroradiometer 
data sets that is often necessary, as radiometric calibra- 
tions are at times uncertain (Mueller and Austin 1995). 
Each year, the BBOP sampling collects over 1,000 spec- 
troradiometer profiles, and the instrument is recalibrated 
at UCSB three times each year. In order to effectively meet 
scientific, logistic, and collaboration goals, these data must 
be efficiently processed and analyzed. 

In anticipation of this large volume of data, as well as 
the rapid turn-around requirements imposed by the cali- 
bration and validation of satellite data sets, a new data 
processing system for large volumes of multispectral pro- 
file data has been developed. In what follows, the struc- 
ture and data flow of the BBOP data processing system 
is introduced. This manuscript is intended as a simplified 
overview and not as a detailed users’ guide (see Siegel et 
al. 1995b for a users’ guide). 
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2.2 PHILOSOPHY 

As with any data processing system, there are sev- 
eral conceptual and philosophical positions that need to 
be taken based on the scientific goals of the project and 
the available resources. In no specific order, the goals of 
the BBOP data processing system are to: 

■ Utilize as much of the existing spectroradiometer 
analysis methods as possible, 

■ Rapidly produce final archival data sets, 

■ Minimize human intervention steps, 

■ Maximize the number of data quality assessment 
and assurance checks, 

■ Generate fully self-describing data sets, 

■ Provide data files in ASCII which are easily read 
and edited, 

a Make quick-look products easy to obtain at several 
stages of the processing, 

a Include processing documentation in the data files 
at each step, 

a Work on many present and future computer plat- 
forms, and 

a Allow much of the data reduction to be accom- 
plished by an experienced undergraduate student. 

As a limitation imposed by the number of casts gen- 
erated and the imposed rapid turn-around requirements, 
each profile cannot be manipulated individually. There- 
fore, in order to assure data quality, many efficient qual- 
ity assessment and control steps must be implemented. 
Known sensor problems must be corrected or flagged . Ex- 
amples of known problems include low signal-to-noise ra- 
tios (SNRs) in irradiance and radiance channels near the 
dark current values, and obvious spiking in data fields due 
to acquisition errors. These problems require that the af- 
fected data values be replaced with trap flags (— 9.9 x 10 35 ) 
so that no processing is performed on these spurious fields. 
In addition, the quality of the data for some applications 
is affected by events occurring during collection, including 
excessive package tilts and variations in incident illumina- 
tion during a cast due to changes in cloud cover. These 
events require that entire data records be qualified. In 
these cases, a new field is created containing a flag which 
defines the quality of the data based on data values in one 
or two fields. Data records containing either trap or qual- 
ity flags can be later deleted or accepted by making simple 
threshold comparisons. 

Provisions also must be made for unknown and unex- 
plained sources of error. These may be simple, the com- 
plete failure of a channel, or insidious, the slow change in 
a calibration constant. To catch these errors, plots must 
be made of several important quantities on a regular basis. 
These may be spectra of calculated diffuse attenuation co- 
efficients, reflection ratios, or simply profiles of processed 


conductivity, temperature, and depth (CTD) data. The 
BBOP data processing system streamlines the plotting of 
important parameters by allowing quick output of selected 
variables as simple ASCII files, which are easily read and 
manipulated by plotting programs. 

The documentation of data processing procedures is of- 
ten neglected in many data processing schemes. For exam- 
ple, it is essential to trace changes in calibration constants. 
Things as simple as the digital filtering method used are 
also important characteristics imposed upon a data set. 
As part of the BBOP data processing system, processing 
documentation is added automatically to the data file so 
that every data user knows explicitly what was done to the 
data file. 

2.3 LCD FILE FORMAT 

At the heart of the BBOP processing system is the LCD 
file and its structure. The LCD file is self-contained, with 
all pertinent header, calibration, and processing history 
included. This system is somewhat redundant since much 
of the header and calibration data will be identical for all 
casts in a cruise; however, the benefits of easy access to 
calibration constants and processing history far outweigh 
the cost of slightly larger data files. During the first 18 
months of the BBOP activity, 20 different calibration files 
have been required due to changes in spectroradiometer 
calibration, ancillary instruments, and collection software. 
Record keeping has been simplified by recording all cali- 
bration information within each data file. The LCD file 
can be stored in a compressed format to save disk space. 

The LCD file is organized into five major sections sep- 
arated by keywords in brackets (<...>). The header por- 
tion, <cruise_info>, contains general cast information 
gleaned from several sources. The <sampled_parameters> 
and <derived_parameters> sections contain a list of the 
contents of the data fields found in the <data> section. 
The <sampled_parameters> section also contains the cal- 
ibration constants. At the end of the LCD file is the 
<f ilters_used> section which contains a record of all 
BBOP programs applied to the file as well as any statis- 
tical output generated by the programs. Excerpts of an 
LCD file after some processing are shown in Fig. 27. 

The LCD file structure is required by all BBOP filters 
and scripts. The choice of a conversion program depends 
on the software used to collect the data. If the data have 
been collected with Biospherical Instrument’s M24-PROF 
software, the LCD file can be created with the BBOP pro- 
gram, mer21cd. The LCD file is created from the card, 
binary, and calibration files. The output is an LCD file 
containing all the necessary features with an abbreviated 
header, which can be augmented later or concurrently by 
using the BBOP shell script smklcd (Section 2.4.1). Once 
the LCD file is completed, it is ready for processing using 
the BBOP filters. 
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<cruiso_inf o> 
filename alll292f 
date 11-12-1992 
position 31 17.96 64 18.81 
cruise b50 


castid index lmer_time ldepth 
alll292f . dtl 2 . 5000000e+01 1 .8150000e+01 
alll292f . dbl 4 . 9100000e+02 1 . 3502500e+02 
alll292f . ubl 5 . 2000000e+02 1 .4727500e+02 
alll292f.utl 9.2000000e+02 2 .4760000e+02 


1 . 3406400e+00 
1 . 2275800e+02 
1.2317100e+02 
1.1174000e+00 


<sampled_parameters> 

led410 0. 4.547500e-02 1.603000e-03 


<derived_parameters> 

kc-led410 


<data> 

-9. 900000e+35 3.457528e+01 3.790249e+01 4.242258e+01 ... 


<f ilters_used> 

bscalc -fr led410 1 20 hmdqalll292f . led. 1 bhmdqalll292f . led . 1 

#stats > samples =* 19 abdev = 1.663616e-01 

int * 3.457528e+01 slope * 9.904044e-01 
min * 9.872207e+00 max = 3.772964e+0i 

mean = 2.863836e+01 stdDev * 1.364106e+00 var = 1.101210e+00 
confidence (95) = 1.381770e+00 

bbopke -fs led410 10 bhmdqalll292f . led. 1 kbhmdqalll292f . led. 1 
Fig. 27, Example of an LCD file. 


2.4 BBOP FILTERS 

The BBOP filters are a suite of UNIX programs de- 
signed to perform a variety of functions in the processing 
of LCD data files: 

mer21cd creates the LCD file from the M24-PROF cre- 
ated card, binary, and calibration files. 

bboprecal recalibrates sampled parameters based on 
new scales and offsets. 

bbopradq compares data to thresholds and replaces 
them with trap flags if they are below the thresh- 
old. 

bbopangq compares package angle data to a constant 
and writes a quality flag. 

bbopkq calculates incident irradiance changes over a 
depth interval and writes a quality flag. 

bbopde spike flags spikes based on thresholds and for- 
ward first difference or slope difference, replacing 
data with a mean of windowed points. 

bbopmovavg smooths data using a moving arithmetic 
mean window (boxcar). 

bboph2o calculates water properties using UNESCO 
FORTRAN routines. 


bbopbin breaks the cast into profiles, sorts the profiles 
on depth, and averages data over depth intervals 
creating new LCD files for each profile. 

bscalc extrapolates data to a null depth ( 2 = 0 ") over 
a specified depth window. 

bbopke calculates the diffuse attenuation coefficients. 

bboptrans performs transformation operations (log, 
sqrt, sin, etc.) on data. 

bbopmath performs simple math operations with data 
by columns, or by one operand and a scalar. 

bbopfutil extracts or removes fields from an LCD file 
and writes the result as a new LCD file. 

bbopdeflag removes or keeps lines of data based on 
flag values and thresholds. 

bbopstrip extracts LCD data columns and writes them 
to a simple ASCII file. 

The filters are designed as stand-alone programs that 
can be applied to LCD files directly or embedded in shell 
scripts. The BBOP Filters axe built using g++ (gcc) version 
2.4.0 and are stable on Sun Microsystems (SUN) Sparc, 
Digital Equipment Corporation (DEC) Ultrix, and SGI 
platforms. The BBOP filters will either replace data val- 
ues within the <data> section of the LCD file, add new 
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Fig. 28. Schematic cartoon tracing some of the processing steps used in BBOP. The outer shell holds the 
shell script(s) which in turn call the BBOP filter(s) within the box. The resulting files are binned, qualified 
LCD files for archiving. 


data fields, or do both. New data field names are placed in 
the <derived_parameters> section and can be operated 
on by most of the filters in the same way as those in the 
<sampled_parameters> section. 

All filters share certain fundamental features: 

1. Filters read and operate on an external ASCII LCD 
file and create an output file with a name speci- 
fied by the user, with the exception of bbopbin, 
which creates the output file name using the input 
file name. 

2. Filters require that LCD files contain all the key- 
words described above. 

3. Filters append the contents of their command lines 
to the <f ilters_used> section of the output file. 

4. Filters will not operate on a field if the same filter 
and arguments have been used before, or if the new 
field name already exists. 

The flow of data processing is controlled using UNIX 
shell scripts written in the Bourne and Bash shells. These 
scripts can create and extract header information, build 
LCD files, and call graphics packages or BBOP filters. The 
scripts are used* to point to the appropriate directories, 
automate processing, check for errors in execution, and 


update log files. Figure 28 illustrates the overall structure 
of the BBOP processing system. The scripts currently used 
are as follows: 

smklcd creates the LCD file from the card, binary and 
calibration files, and cruise notes. 

szcorr recalculates the pressure channel using a new 
cruise offset. 

stranscorr recalculates the transmissometer channel 
using the new cruise air calibration and dark offset. 

sbt determines tops and bottoms of profiles using an 
interactive Matlab script and inserts the castid ta- 
ble into the LCD header section. 

srakq qualifies data based on dark value thresholds, 
instrument tilt, and constant surface illumination 
intensity. 

sdespike despikes conductivity, temperature, fluorom- 
eter, and transmissometer data twice (two passes). 

smovavg smoothes despiked conductivity, temperature, 
fluorometer, and transmissometer channels. 

sh2o calculates salinity, <r, a t , potential temperature, 
and a#. 
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sbin breaks a cast into profiles, and sorts and averages 
the data into 1 m bins. 

sbsc extrapolates below surface ir radiance and radi- 
ance to a null depth over a predefined window using 
the robust algorithm. 

skc calculates attenuation coefficients over a 10 m mov- 
ing window. 

smath calculates irradiance and radiance products and 
ratios. 

sdef lag removes data lines containing trap flags. 

sloop is a simple looping program for passing file names 
to other scripts. 

scmds automates the entire BBOP processing system 
(see example below) . 

The scripts calling individual BBOP filters can be run 
singly, or more commonly, are combined in a global script 
(scmds). By combining the scripts and utilizing the UNIX 
environment, the entire data processing system can be au- 
tomated. Figure 29 shows an example of the global script 
scmds, processing a recalibrated LCD file through comple- 
tion. 

# ! /local/gnu/bin/bash 

lcd_f ile =t basename $l f 

logf ile»$PVD/log/${lcd_f ile} . log 

echo -n "$lcd_file : M ; date 
srakq $1&&\ 

sdespike q${lcd_f ile}fc&rm q${lcd_f ile}&&\ 
sfmovavg dq${lcd_f ile}fcferm dq${lcd_f ile}&&\ 
sh2o mdq${lcd_f ilelfeferm mdq${lcd_f ile}fcfe\ 
sbin hmdq${lcd_f ile}&&\ 

{ for filename in 'Is hmdq${lcd_f ile } . +* 
do 

sbsc $f ilename&&\ 

skc b${f ilenamel&fcrm bhmdq${lcd_f ile} . ♦fe&X 
smath kb${f ilename} 
done > 
date 

> 2>fcl | tee -a $logfile 

Fig, 29. An example of the global script scmds. 

The && construct allows the following command to be 
executed only if the command preceding it is successful (re- 
turns a zero exit value). This insures that if one step fails, 
the running of the script on a particular file will stop. The 
standard output of each script is sent to a log file for each 
LCD. Each script called in scmds prefixes a unique letter to 
the input file name. For example, hmdqa010193 . led indi- 
cates that the scripts srakq, sdespike, smovavg, and sh2o 
have been run on the LCD file a010193.1cd. In scmds, 
most intermediate LCD files are removed with the excep- 
tion of the files that precede and follow bbopbin, which 
are later archived. Files are available for quick looks at 
any step within the processing sequence. 


2.5 DATA PROCESSING STEPS 

2.5.1 Bottom-to-Top Indexing 

Because the LCD file must be eventually split into in- 
dividual profiles, each cast is examined to determine the 
tops and bottoms of down- and up-casts. Initially, an au- 
tomated method for marking these points was pursued, 
but the great variety in the shape of the time versus depth 
curve made this determination prohibitively complicated. 
It was decided that the time versus depth curve must be 
evaluated manually for each cast. There are any num- 
ber of ways this could be done. Mat lab, a commercial 
software package, was chosen as a GUI to allow a trained 
user to interactively select these points. A table comprised 
of a header line and corresponding indices and depths is 
inserted into the <cruise_inf o> section of the LCD file 
(see the example LCD file). These indices and depths are 
points marking the tops and bottoms of the profiles within 
the cast. Once these data are inserted, the first line of the 
table (beginning cast id) functions as a list of keywords. 
The data within this table are used by bbopkq in anticipa- 
tion of the binning process and then by bbopbin. 

2.5.2 Recalculation 

Recalculation may be needed due to changes in instru- 
ment calibration constants, at-sea atmospheric pressure 
offsets, or transmissometer offsets. The bboprecal filter 
converts data from engineering units to voltages using scale 
and offset values from the <sampled_parameters> section 
and converts back to engineering units using the scale and 
offset values from the command line. The new scale and 
offset constants are inserted following the variable name 
in the <sampled_parameters> section maintaining a cali- 
bration history within the LCD file. Recalibration is not 
implemented for Sea-Bird (CTD) sampled parameters or 
derived fields. 

2.5.3 Data Qualification 

Because the BBOP data processing approach minimizes 
human intervention, the number of data quality assessment 
and assurance checks that are made as part of the BBOP 
data processing is maximized. The first data qualification 
uses bbopradq to assess the ambient light levels for each 
channel. When ambient light levels fall below a prede- 
fined level, the individual data fields are replaced by a trap 
flag (—9.9 x 10 35 ). At all later stages of BBOP process- 
ing, flagged fields are not operated upon. Lines containing 
these flags can be later deleted using bbopdef lag or in an 
application program. 

The bbopangq filter qualifies lines of data based on the 
orientation of the radiometer in the water, since spectral 
data may be compromised by excessive tilting of the instru- 
ment. This filter creates a new field containing a quality 
flag rather than replacing data in a field. 
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Fig. 30. Incident downwelling irradiance (solid) and K d quality (KQ) flags produced by bbopkq. Regions of 
non-zero KQ flags (shaded) indicate periods where the calculation of K d (z,\) may be uncertain due to variable 
incident irradiance. Lines of data can be later deleted or accepted using bbopdef lag and user specified flag 
thresholds. 


Accuracy of the diffuse attenuation coefficient calcula- 
tion is strongly dependent on a constant intensity of inci- 
dent radiation during the calculation time interval. The 
bbopkq filter is used to identify the segments of the cast 
over which surface illumination is steady enough for the 
diffuse attenuation coefficient to be accurately determined. 
The bbopkq filter uses the cast id table information to 
perform its qualification in anticipation of the binning and 
calculation of attenuation coefficients (see bbopkc in Sec- 
tion 2.5.8). The bbopkq routine calculates the standard 
deviation and the mean of the first difference for the group 
of points centered at each data line within the user-selected 
depth interval (in meters) over which the attenuation coef- 
ficients will be calculated. The user also specifies a thresh- 
old values for the standard deviation and maximum first 
difference with which bbopkq compares its calculated val- 
ues and writes a quality flag into a new field dependent 
upon the results of the comparison. Later, these flag values 
can be used to assess the quality of the calculated diffuse 
attenuation coefficients (Fig. 30). 

2.5.4 Despiking and Smoothing 

Two types of digital low-pass filters are used to reduce 
spurious data values (spikes) within the BBOP data pro- 
cessing system. The first filter (bbopdespike) uses two 


criteria, either together or individually, to flag potential 
data spikes. Flagged values are either replaced with arith- 
metic means over a user defined window or trap flags if no 
valid (non- flagged) data exists within that window. The 
criteria are based upon either a forward first difference or 
a forward slope difference compared to specified thresh- 
old values. The second filter, bbopmovavg, uses a moving 
arithmetic mean (boxcar) with the window size defined by 
the user. Despiking and smoothing are carried out on tem- 
perature, conductivity, transmissometer, and fluorometer 
fields only. Both the despiking and moving average filters 
create new fields, leaving the input field untouched. 

2.5.5 CTD Calculations 

The bboph2o routine calculates water characteristics 
using the standard UNESCO FORTRAN subroutines and 
writes the calculated parameter as a new field in the LCD 
file. The bboph2o routine must have despiked temperature 
and conductivity data to produce a smooth salinity pro- 
file. Time constant differences between the conductivity 
and temperature sensors are accounted for using a single- 
pole digital filter. The following parameters are calculated: 
salinity, in situ density, cq, potential temperature, oq , and 
coefficients of thermal and saline expansion. 
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2.5.6 Binning 

A cast may contain from one to several up or down pro- 
files (yo-yos) and hence, may not be monotone in depth. 
The binning filter, bbopbin, uses the information from 
the cast id table to break up the LCD file into individ- 
ual daughter profiles that are sorted based on pressure 
and compacted using arithmetic averages over a pressure 
interval (bin±Ap). The resulting pressure field for each 
binned profile is also binned to evaluate the true depth of 
each binned data record. Each daughter LCD file retains 
the complete header and processing history of the original 
LCD file and contains two new <derived_parameters> 
fields named bin_m, where m is the interval chosen by the 
user, and bin.pt s, containing the number of raw band- 
width data records that have been averaged into that bin. 
If the file is missing pressure interval data near the sur- 
face, bbopbin fills in the lines for the missing bins with 
trap flags such that the binned LCD file begins at its low- 
est bin interval (i.e. , 1.0) and increases monotonically. 

2.5.7 Null Depth Extrapolations 

The determination of optical fluxes just beneath the sea 
surface, or at null depth, are of obvious relevance for ocean 
color remote sensing (Dickey and Siegel 1993 and McClain 
et al. 1993). The direct determination of null depth op- 
tical signals is particularly difficult due to high levels of 
surface wave glint noise and uncertain water depth deter- 
minations. In order to provide accurate data at a null 
depth for the irradiance and radiance channels, profiling 
data sets must extrapolate their signals to the sea surface. 
The BBOP filter bscalc employs an algorithm which sta- 
tistically extrapolates a depth profile to the surface over a 
user-specified depth interval. The bscalc filter allows the 
user to specify both the upper and lower bounds in the 
extrapolation interval, and the log-transformed fields are 
extrapolated to the sea surface using the Beer-Lambert re- 
lation (Smith and Baker 1986 and Siegel and Dickey 1987). 
Two extrapolation algorithms are currently available, the 
standard chi-square (x 2 ) algorithm and a robust algorithm 
which eliminates points greater than two standard devia- 
tions (2a) from the mean (Press et al. 1992). The bscalc 
filter does not make any derived fields, but rather creates 
a new line of data at the top of the <data> section with 
0 in the bin.m field and trap flags in any field for which 
the extrapolation was not calculated. Statistics for the ex- 
trapolation fits are included following the command line in 
the <f ilters_used> section (see the example LCD file). 

2.5.8 K Calculations 

The BBOP filter bbopkc calculates the attenuation co- 
efficient, Kd(z,\), at each binned depth interval using the 
Beer-Lambert relation by employing a sliding regression 


window. This procedure is similar to that employed by 
Smith and Baker (1984) and Siegel and Dickey (1987). 
The user specifies the channel, algorithm, and depth win- 
dow over which to perform the regressions using either 
standard x 2 or robust algorithms (Press et al. 1992). It 
was decided not to normalize the underwater irradiance 
fields to simultaneous above-water irradiance data for the 
Kd(z,\) calculations. The approach is to select profiles 
that are free from perturbations and to create composites 
of profiles based on bbopkq KQ flags. It is unclear whether 
the normalization would be relevant in a quickly changing 
irradiance field due to the passing of small convective cloud 
elements. Furthermore, it is uncertain whether a surface 
irradiance normalization routine will mask any variations 
associated with the incident radiance distribution. The 
depth window used with bbopkc should be the same as 
was used for bbopkq. 

2.5.9 Simple Math and Transformations 

A variety of utility BBOP filters are also available. For 
example, bbopmath performs simple math operations on 
LCD data fields (add, subtract, multiply, ratio), and adds 
a new field to the data section. The bboptrans filter per- 
forms simple math transformations (log, exp, sin, asin, 
sqrt, etc.) on the data and adds a new field to the data 
section. Both these tools are used in the final stages of pro- 
cessing to produce spectral ratios and reflectance ratios, as 
well as to calculate the beam attenuation coefficients for 
the transmissometry field. 

2.6 CONCLUSIONS 

The BBOP data processing system meets the data pro- 
cessing goals. By making this system available to the com- 
munity, other investigators will hopefully benefit from the 
investments made at UCSB and will contribute incremen- 
tal improvements to the existing system. It is intended 
that investigators will customize or rewrite the filters and 
scripts to suit their own needs and systems, as well as 
contribute suggestions for improvement. This processing 
system and source code are available to anyone via anony- 
mous ftp from ftp.icess.ucsb.edu (/pub/bbop/soft). 
The BBOP data processing system, however, is not in- 
tended as a software product, but the usual free software 
licensing caveats apply. 
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Chapter 3 


Integral Method for Analyzing Irradiance and 
Radiance Attenuation Profiles 

James L. Mueller 

San Diego State University, San Diego , California 
Abstract 

A method is presented for determining the profile of attenuation coefficient (K) for a vertical profile of irradiance 
or radiance through a least-squares fit to the optical depth profile, expressed as the integral of K from the surface 
to each depth z. The measured optical depth at each z is calculated as the natural logarithm of the surface- to- 
depth ratio of measured irradiances (or radiances). The K profile is represented analytically by Hermitian cubic 
polynomials connecting nodes at several discrete depths, with unknown values of K and its vertical derivative at 
each node as coefficients. These polynomials are integrated analytically to each z, which allows each measured 
optical depth to be set equal to a polynomial with node values of K and its derivative at the node depths. 
This results in an overdetermined set of equations corresponding to all measured depths in the irradiance (or 
radiance) profile, which is solved using classical least-squares methods. Prior to solution, irradiance data are 
normalized to minimize effects of surface irradiance variations, and segments near major anomalies (resulting 
from strong cloud shadows or ship shadows) are eliminated from the fit. In contrast to the classical derivative 
solutions for K , the integral approach ensures a correct representation of total attenuation through missing data 
intervals. 


3.1 INTRODUCTION 

Vertical profiles of downwelling irradiance E d (z,X) are 
related to E d ( 0“, A), incident irradiance just below the sea 
surface, by the equation 


x 

- J K d {z',\)dz' 

E d (z, A) = E d ( 0',A)e » (1) 

The function K d {z,X) is the profile of irradiance attenua- 
tion coefficients throughout the water column. This same 
equation relates upwelling irradiance E u (z,X) to £^(0’, A) 
and K u {z,X) and relates upwelling radiance L u (z,X) to 
£u(0">^) and K L (z,X). 

It has become relatively common practice to measure 
vertical profiles of E d {z, A), £ u (z, A), and L u (z, X) using 
underwater radiometers, with the usual objective being to 
determine K d {z, A), K u (z, A), and Ki{z, A). The classical 
approach to determining K(z,X) from E(z,X) is described 
in detail by Smith and Baker (1984 and 1986). It is nec- 
essary to first normalize the £(z,A) profile to surface irra- 
diance E s (z,X) profiles, measured on the deck of the ship 
during a cast. K(z, A) is then determined by estimating 
the slope of ln(£(z,A)) at depth z; this is accomplished by 
least-squares fitting a straight line through a data window 
extending several meters above and below depth z. The 


window is then slid down approximately 1 m and a least- 
squares K is determined again, and so on over the entire 
profile. 

A typical window size ranges from 8 m (Smith and 
Baker 1984 and 1986) to 20 m; the latter is used in the 
present work for preliminary K estimates. This precludes 
the fitted K profile from following rapid variations through 
sharply defined layers of suspended particles, which are 
commonly observed in beam attenuation profiles in coastal 
and frontal water masses. Even with a 20 m window, more- 
over, the local slope-fitting procedure is sensitive to high 
frequency fluctuations in incident irradiance which are not 
in phase at the on-deck and underwater radiometers. 

A new method is presented for determining K profiles 
by minimizing the departure of the estimated optical depth 
profile 

z 

f(z,\) = J K(z', X)dz' (2) 

0 

from the measured optical depth profile 


T(2,A) 


In 


~ E(0-,\) ' 
. E(z,\) . 


( 3 ) 


The new approach has the advantage of being able to 
more closely follow variations in K through very turbid 
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layers, as indicated independently by beam attenuation. 
At the same time, the integral approach is more successful 
at smoothing through surface irradiance fluctuations than 
is the local slope-fitting method. 

3.2 DECK CELL SMOOTHING 

The first step in this procedure is to fit the deck cell ir- 
radiance profiles E s (z, A) directly to Hermitian cubic basis 
functions, 

7 oi (0 = ^-l) 2 (£ + 2 ), 

702(f) = ^(f + l) 2 (f- 2 ), 

L W 

7 n(f) = f(f-l) 2 (f + l), and 

712(f) = y(f + l) 2 (f-l). 

For z in the ith depth element 1 < z < z*, £ is a 
local coordinate ranging from —1 at node Zi-\ (the shallow 
end point of the element) to +1 at node Z{, that is, 


which E s fluctuations follow closely is one subjective el- 
ement in this procedure. The recommended practice is 
to pick nodes which allow the fitted curve to closely fol- 
low fluctuations with wavelengths greater than or equal to 
10 m, and to smooth out shorter scale fluctuations. In the 
time domain, 10 m corresponds to approximately 20 s at a 
typical winch speed of 0.5 ms -1 .) The smoothed E s (z, X) 
and normalized Ed(z, A) profiles should, in any event, be 
examined jointly before proceeding further. If features in 
the fitted E s curve are reflected by opposing features in 
the Ed curve indicating overcompensation by the deck cell 
normalization, then the data from that segment of both 
profiles should be eliminated from the fitting procedure. 

Once node depths z n are selected, the E s (z m ,X) vector, 
measured at m = 1, . . . ,M depths z m , may be expressed 
in matrix form as 

E s (z m) X) = ME s ( A), (9) 

where E a (X) is the measured irradiance vector of length M 

( E a (z u X) \ 

E a (z 2 ,X) 


f 



+ 



( 5 ) 


E.( A) = 


E s (z m ,\) ' 


(10) 


with differential 

df = ^-dz, (6) 

hi 

where Li is the length of ith finite element, i.e., 

Li = Zi (7) 

At any depth 2 corresponding to location £ in element 
ij the smoothed estimate of deck cell irradiance E a (z,X) 
will be given by 


\ Es{z\f,X) ) 

E s (A) is the unknown vector (of length 2N) of irradiances 
and vertical gradients of irradiance at the N node depths 

/ I*,o(A) \ 

E., x(A) 

E s ,n( A) 


E,{z, A) = 7oi(f)-E s ,i-i(A) 

+ 7o2(f)£«,i(A) 

+ 7n(f)^,i-i(A) 

+ 7i2(f)^M(A), 


Es( A) 


E S) n-i(X) 

Jl^.o(A) 

-§lE S ' i(A) 

A) 


( 11 ) 


where E 3yi (A) is the value of E s (z, A), and -§lEs,i{ A) is its 
derivative with respect to 2 , at node depth Both the 
function E s (z,X) and its first derivative are continuous at 
nodes joining adjacent finite depth elements. 

The profile of measured E a (z,X) is displayed on the 
computer’s screen. Nodes are placed at N depths z n (n = 
0, . . . ,N — 1) selected to allow the cubic functions of (8) 
to closely follow major excursions of incident irradiance, 
while smoothing high frequency wiggles which are unlikely 
to be well matched to incident irradiance fluctuations ob- 
served by the underwater radiometer. The selection of 


V -§^E St M-i(X) / 

and H is a matrix with 2 N columns and M rows 


H = [/imj], 

with elements 


* mj 


7oi ? Zm in element n and j = n — 1; 

711 , z m in element n and j = n - 1 + N; 

702 , Zm in element n and j — n; 

7l2 > Zm in element n and j = n + N] 

0, otherwise. 


(12) 


(13) 
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To reduce (9) to normal form for least-squares deter- 
mination of the vector E s , multiply both sides by H T , the 
transpose of H, and rearrange to obtain 

#,(A) = [H T M]" 1 H r ^(A), (14) 


where [HTlHl] -1 is the inverse matrix of [H T HI] . 

The resulting components E S}n (\) are the coefficients 
needed, together with the array of node depths z„ , to com- 
pute smoothed deck cell irradiance E $ ( A) at any depth z 
using either (8) or its matrix equivalent (9). 

The smoothed E s profiles are now ready for use in ob- 
taining smoothed fits to measured profiles of downwelling 
irradiance Ed(z,\), upwelled irradiance E u (z, A), and up- 
welled radiance L u (z, A). To provide guidance for node 
placement in a least-squares fit to cubic Hermitian finite 
elements, the profiles are first binned to 1 m intervals, and 
preliminary attenuation coefficients K are estimated using 
the classic practice of fitting a least-squares slope over a 
window extending a few meters (in this case ±10 m) on 
each side of each depth point, e.g., Smith and Baker (1984 
and 1986). 


natural logarithm of smoothed irradiance or radiance at 
depth z, i.e., 


A d (z, A) = In [E' d (z, A)], 

A u (z, A) = In [£(,( 2 , A)] , and (17) 

Ai (z, A) = In [14 ( 2 , A)]. 


The values of E' d (z, A), E f u (z, A), and L^(z,A) [as ob- 
tained from Ad{z,\), A u (z, A), and A/(z,A) by the above 
least-squares smoothing algorithm] are then each normal- 
ized to the surface by the ratio of deck cell irradiance 
E s (0,550) :E 9 (z f 550) calculated using (14). 

The resulting smoothed profiles of K' and E f are used 
as a guide in selecting node depths for fitting improved K 
and E profiles to the measured irradiance. 


3.4 OPTICAL DEPTH PROFILE FIT 


Measured optical depth r(z) at depth z is calculated 


as 


r(z) = In 


' g(Q-) ' 

. e { Z ) r 


(18) 


3.3 BIN- AVERAGED PROFILES 

Profiles of E d (z, A), E u (z, A), and L u (z,\) are averaged 
into 1 m depth bins in preparation for preliminary least- 
squares smoothing to obtain the vertical attenuation coef- 
ficients of each quantity. The preliminary smoothing algo- 
rithm outlined below is similar to that described by Smith 
and Baker (1984): 


K' d (z, A) = 
K{z, A) = 
K’ l {z, A) - 


-1 d 
Ed{z,\) dz 
-1 d 
E u {z, A) dz 
-1 d 
Z u (z,A) dz 


Ed{z,X) ) 
E u {z, A), 
L u (z, A) 


and 


(15) 


where E may be Ed , E u or L U1 and E(0~) is irradiance 
(or radiance) just beneath the sea surface. A first guess 
estimate of E(0“) is obtained from the preliminary bin- 
averaged, window- fit K f and E f profiles as 

E{ O’) ^ £'(10)e 10K ' (10) . (19) 

[Because of the 20 m fitting window, #'(10) and E'(10) at 
10 m are the shallowest estimates in that profile.] 

Optical depth is related to the irradiance (or radiance) 
attenuation coefficient K(z) profile by the 


r(z) 


J K(z')dz'. 


0 


( 20 ) 


are determined by least-squares fits to the equations 


In 


In 


In 


£ d (2,A)£,( 550) ' 
£,(2,550) 

£ U (2,A)£,(550)' 

£,(2,550) 

L u (2, A)£,(550)' 
£,(2,550) 


= A d (z, A) - K' d {z,X)[z - z\, 
= A u (z,X)-K' u (z,X)[z-z}, 
= Mz,X)-Ki(z,X)[z-z], 


(16) 


If once again the water column is divided into N — 1 
finite elements, separated by N nodes at depths z n (n = 
0 , ... ,7V — 1), K(z) may be estimated in the depth element 
2 n _ i < 2 < 2 n as 


K(z) = 'yoiitfKn-i + 7 o 2 (^)AT„ 

+ + 7l2(o|-^n 


( 21 ) 


where z is the mid-depth of a 20m window, E s ( 550) is the 
smoothed 550 nm deck cell irradiance at depth z, £ 5 (z,550) 
is the 550 nm deck cell irradiance coincident with measure- 
ments at depth z, and the intercepts A correspond to the 


where 7ij(£) and £ are defined in (4) and (5), respectively. 
The same form of cubic Hermitian polynomial expansion 
is used in (8) and (21) to represent the variables E s (z) and 
K{z), respectively. 
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If (21) is substituted into (20), the resulting equation 
obtains for z n _ i < z < z n : 


r(z) = 7oi(f)dz' + Ki- 1 J 702(0^ 

l_1 ^ z i~l z i - 1 

+ J 'rniOdz + £- z . Ki J 7 i 2 ( 0 ^' 

*i-l *i-l 

2 2 

4 - i^n-l J 70 l(Od^ + j 702(0 dz' 

Ztx -1 Zn -1 

2 2 

+ J^n-i j 711(0^+ ^ Kn f^w. 


where 


r l 


kmi — \ 


( 22 ) 


2 ~ ffoi(0. 

Lx 
2 ’ 

Z/i + 1 + Li 


~9oi(0 
Ln~ 1 


n = 1, i = 0; 
n > 1, t = 0; 
n>l t 0<t<n — 1; 

n > 1, i = n — 1; 


(27) 


and 


L n 


( L 


■002(0* i = n; 


By the definition of £ and its differential in (5), vari- 
ables may be changed to express the integral terms in (22) 
in the form 


z £ 

J l{Qdz' = Y J 7 (?)<%'■ 

'■n—l -1 


(23) 


bn,i+N — \ 


Thus, (22) may be formally integrated from = -1 to 0 
to obtain new coefficients 


£01 (0 


, x -1 
902(0 = y 

gn(€,Li) = y 


r ^ 4 3£ 2 13 

4 2 + 2? + T 

^4 3^2 -3 

T 2 

r £ 4 ^ ^ 


if 


^- 9 n(^,Li), n= l,i = 0; 

n > 1, i = 0; 
n> 1, 0 < i < n — 1; 


2 

L J 
12 ’ 

r 2 r 2 

^i + l “ 


2 

+ 


12 


£ll(£,£n) 


r 2 

-kn-l 


(28) 


12 


n > 1, i = n — 1; 


2£ 


11 

4 3 2 + 5 + 12 


(24) 


- 0 i 2 (£vM, i = n. 


The coefficients w m in (26) weight the relative impor- 
tance of each mth measurement in the r profile. A rela- 
tively simple weighting prescription is used at the time of 
this writing. The weighting coefficient at each depth z m is 
first computed as 


gi2(€,Li) = 


Li 


+ e 


e 

2 




w„ 


So ( 2 m)’ 


(29) 


with values at £ — 1 (i.e., the integrals over a complete 
finite element from —1 to 1): 

<7oi (1) “ 

002(1) = 1, 

L t (25) 

p n (l,Li) = and 

912 ( 1 , Li) = zh. 

With substitutions from (23) through (25) and some re- 
arrangement of the terms involved, (22) may be expressed 
for Z = Z m , Zn- 1 < < Z n , *S 


WmT(z m ) = IC„ 


i=0 L 




(26) 


where so(z m ) is the standard deviation of measured deck 
cell irradiance E s (z, A) relative to the smoothed profile 
[computed using (8-15)] over the 10 m depth interval cen- 
tered at z m . This weighting gives reduced importance 
to irradiance measurements made when surface irradiance 
fluctuates rapidly, e.g., due to variable cloud cover, and in- 
creased importance to measurements made when incident 
irradiance is relatively steady. In depth intervals where 
both the surface and normalized subsurface irradiance pro- 
files exhibit relatively large amplitude fluctuations, w m 
are further multiplied by 10 -6 to completely discount ob- 
servations where incident irradiance variations viewed by 
the deck and underwater radiometers are obviously not in 
phase. 

Ship shadow contamination can be visually recognized 
in many irradiance profiles measured under overcast condi- 
tions. The characteristic shape of this phenomenon is illus- 
trated in Voss et al. (1986). In profiles where ship shadow 
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is present, the resulting curvature in the upper layer can 
distort the K and irradiance profile fits over the upper 
100 m. In principle, a ship shadow model could be used 
to correct the profile explicitly, but research to develop 
and test the implementation of such a method is beyond 
the scope of the present report. As an interim substitute, 
multiply the weighting coefficients w m by 10“ 4 at depths 
where ship shadow curvature is visually apparent. With 
the surface layer boundary conditions used at present (see 
below), this has the effect of passing a straight line to rep- 
resent E(z, A) from the surface intercept to the depth of 
the first node selected by the operator, without regard to 
any curvature that may be apparent in the measured data. 

In matrix form, (26) for m = 1, . . . ,Af profile observa- 
tions at depths z m are combined as 

f = WK. (30) 


The M elements of the vector f are r m = w m r(z m ), calcu- 
lated from the data with (18). The elements of the M x 2N 
matrix H are where h mi are defined in (27) for 

i < n, in (28) for N < i < n + A, and h mt — 0 for 


n < i < N and i > n 4- N . Finally, the vector K is defined 
as 


/ \ 


K i 


K n 


K 


K 


N~\ 




(31) 




V 1 / 


i.e., the unknown vector of attenuation coefficients and 
their gradients at the N nodes. 

As with E s , K is determined by the least-squares so- 
lution to (30) as 


K = [e r H] 1 H T f, (32) 

which can be solved using any standard matrix inversion 
program. In implementation, the singular value decom- 
position method and computer codes used were given by 
Press et al. (1992). 


To constrain the solution at the surface node, which 
depends on the entire data profile below it, it is required 
that 

K 0 = Ki, (33) 

which implies further that 

= d_x 

dz K ° ~ dz Ku (34) 

= 0. 

In other words, a layer of constant K is imposed be- 
tween the surface and the depth of the first node selected 
by the operator. 

The bottom boundary values are not constrained, and 
frequently take on unreasonable values. The solution at the 
bottom node is determined only by the data in the deepest 
finite element, when the data values are near the minimum 
detectable level of the instrument, and consequently are 
noisy. To minimize the influence of the bottom node on 
the overall profile, a thin (less than 10 m) bottom element 
is selected by picking the second deepest node (node index 
N — 2) very close to the deepest one (index N — 1). Then 
ignored is the fitted curve in this bottom boundary layer 
simply by dropping node N — 1 when the fitted K and E 
curves are calculated using (22) and (30). 

This completes the mathematical description of the fit- 
ting procedure. In use, the first estimate bin-averaged 
E'(z) profile is overlaid on the measured E(z) profile on 
the computer screen. To aid the operator in selecting node 
depths, profiles of bin-averaged K f (z ) and smoothed deck 
cell irradiance E s (z) are also displayed. If data from a 
beam transmissometer or fluorometer are available, the 
profiles of beam attenuation coefficient c p (z) and chloro- 
phyll a fluorescence F(z) are displayed as a further guide to 
selecting node depths. The operator then interactively se- 
lects an array of node depths, observes the resulting fit ob- 
tained using (18-32), and iteratively adjusts node depths 
and refined estimates of £(0") until a best fit is obtained. 

After this procedure has been applied to all radiometer 
channels, each profile of Kd{z, A), K u (z, A), and Kl(z, A) is 
represented by a vector of node depths z n and the associ- 
ated vector K , as given in (31). The fitted curve for each 
K(z, A) can then be calculated using (22). To calculate 
the fitted Ed(z, A) profile, (30) is first used to calculate the 
td(z, X) profile and then 

E d (z,X) = E d { 0- ,\)e- T “( z ' x l (35) 

The same procedure is used to retrieve E u (z, A) and 
L u {z^X) profiles from the Hermitian finite element repre- 
sentation. 
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Chapter 4 


Automated and Interactive Bio-Optical 
Processing Package 

Curtiss O. Davis 
W. Joseph Rhea 

Naval Research Laboratory, Washington, DC 
Abstract 

Underwater profiles of upwelling and downwelling irradiance, as well as upwelling radiance have been collected 
from a wide variety of ocean environments. To obtain apparent optical properties from these data requires 
removing data spikes, binning and smoothing, and removing possible artifacts from changes in surface illumi- 
nation, ship shadow, or reflections and wave focusing. To accomplish these data processing requirements, the 
AIBOP software package was developed. In the AIBOP system, the data is processed in two parts: first, an 
automated de-spiking and binning routine, and second, interactive spectral processing to remove the effects 
of changes in surface illumination, ship shadow, or reflection and near-surface effects such as wave focusing. 
Once the data is processed, routines are provided for calculating extinction coefficients, surface radiance and 
irradiance values, and remote sensing reflectance. 


4.1 INTRODUCTION 

Optical data has been collected with a BOPS as part of 
a number of interdisciplinary oceanographic expeditions, 
such as, the JGOFS EqPac and Arabian Sea programs. 
The BOPS records 44 channels of data and extensive pro- 
cessing is required to retrieve AOPs from the measured 
underwater light fields. To provide accurate, rapid pro- 
cessing of these large data sets, a AIBOP software package 
written by W. Rhea using IDL from Research Systems, 
Inc. The full processing of the data was broken down into 
two distinct levels, the first one being an automated de- 
spiking and binning routine, and the second one being a 
more detailed, user-interactive spectral processing section 
where underwater optical effects, such as ship shadow, were 
removed from the data. 

The philosophy behind the development of the AIBOP 
software centered on the desire to process all possible op- 
tical casts, not just those made under ideal environmental 
conditions. Due to the number of different projects com- 
peting for wire time during most research cruises, often 
only one optical cast was made per day. Under these con- 
ditions, it is necessary to use all possible data, even if it 
contains correctable optical contamination, such as inter- 
mittent clouds, wave focusing effects, and occasionally ship 
shadow or ship hull reflection. The AIBOP software was 
designed specifically to remove as many of these effects as 
possible. 


4.2 INSTRUMENTATION 

Optical data were collected with a BOPS, an updated 
version of the BOPS originally developed by Smith et al. 
(1984). The package is built around a Biospherical In- 
struments MER- 1048 spectroradiometer, which measures 
upwelling and downwelling spectral irradiance as well as 
upwelling spectral radiance. The data collected with the 
BOPS consists of 44 parameters and includes the following 
measurements made by the MER: 

■ 13 channels of downwelling irradiance, Ed , rang- 
ing from 410-710 nm; 

■ 8 channels of upwelling irradiance, E u , ranging 
from 410-694 nm; 

■ 8 channels of upwelling radiance, L u , ranging 
from 410-683 nm; 

■ Photosynthetic ally available radiation (PAR); 

■ Depth; and 

■ Instrument tilt and roll. 

In addition, conductivity and temperature were mea- 
sured with a Sea-Bird CTD, chlorophyll fluorescence was 
measured with a Sea Tech fluorometer, and beam transmis- 
sion was measured with a Sea Tech 25 cm transmissometer. 
Simultaneously, a deck cell collected 4 channels of surface 
downwelling irradiance, £^(0+), ranging from 410-683 nm. 
The MER acquired all the in situ data 16 times a second, 
averaged it to four records a second, and sent it up the 
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31, 43, 44 

******** DATA PROCESSING NOTES ********* 

Post-cruise (WJR) - Data processed using calibration file listed below. 
Initial data-cleaning limited to occasional data spike or gap removal. 

Data then binned to 1 meter depths. 

09/91 (WJR) - Reprocessed Lu channel using time-averaged comparison between 
original calibration (06/11/87) and SDSU/CHORS calibration (07/17/91). 
******** VERTICAL CAST CASTCARD ******** 

FILE w910321a; 03-21-1991 

CRUISE IDENTIFICATION WHITE POINT OUTFALL - 03/91 

CALIBRATION FILE 8302W10a.cfl 

CALFILE DESC MER-1048-8302 Recalibrated for JPL 12 MAR 1991 

NAME w910321a 

DATE 03-21-1991 

STATION STA 1 

Position LONG: 118-20.41 W 

LAT : 33-41. 20 N 

SKY CONDITION CLEAR 

OPERATOR NAME WJR 

SUN POSITION 2 

HANDSHAKE 1 

ANALOG CHANNELS 35 

FREQUENCY AVERAGED 1023 

ANALOG CYCLES AVERAGED 4 

START TIME 12:23:41 

DOWNCAST ENDING MARKED AT RECORD 1391 
UPCAST ENDING MARKED AT RECORD 2423 

FINAL TIME 12:35:25 

TRANSMISSION ERRORS 0 

NORMAL TERMINATION OF DATA LOGGING. 

TOTAL RECORDS RECORDED 2462 

Record , Ed410 , Ed441 , Ed488 , Ed520 , Ed550 , . . . 
4,102.0160,118.3141,143.5586,138.1729, . . . 

Fig. 31. An example of a working data file. 


cable to a deck box and a PC which stored the data on a 
hard disk. 

4.3 LEVEL -1 PROCESSING 

The first level of processing the BOPS data began with 
a decision to use either the downcast or upcast, depend- 
ing upon various criteria including absence of clouds in the 
data, absence of ship shadow, and absence of data spikes 
or dropouts cause by occasional pauses in the data trans- 
mission from the MER to the onboard computer. The next 
step was an automated process to remove any remaining 
data spikes or dropouts from the selected cast data and re- 
place them (typically single values) with interpolated val- 
ues. 

The data was then checked for single points lying out- 
side 3 a of a 7-point bin, and any outlying points were then 
replaced with interpolated values. This was done to re- 
duce much of the effects caused by wave focusing in clear 
waters. This cleaned data was then mean-binned into 1 m 
intervals, centered on the half meter. This completed the 
level -1 processing. 


4.4 LEVEL -2 PROCESSING 

The level -2 processing involved interactive spectral pro- 
cessing of the data. First, ship roll was removed from sur- 
face light channels (when necessary) by applying a seven- 
point running mean filter to each of the four surface light 
channels. Next, cloud effects were removed from the un- 
derwater light field by normalizing each underwater opti- 
cal channel to either the mean or maximum of the closest 
matching surface light wavelength. The decision whether 
to use the mean or maximum of surface light value de- 
pended on the nature of the light field during the cast. In 
general, the maximum value was used when the sky was ei- 
ther very clear or fully overcast. The mean value was used 
only during partly cloudy conditions where bright clouds 
caused a brief increase in measured light levels on either 
side of the cloud with a shadow in the middle. In these 
cases, the mean light value more closely matched the over- 
all clear-sky light levels than did the maximum light value. 

Also, when needed, the surface light channel records 
were shifted slightly in time before normalizing the under- 
water data to account for the difference between the time a 
cloud passed over the surface and underwater arrays. This 
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52, 43, 44 

33.68667,-118.34016, 80.51598, 80.84930 

======ss============s= 5 S============BEGIN j 1EADER======s============;s== = = = = == ====== = = = 

DESCRIPTION OF FIRST LINE IN FILE (BEFORE HEADER) : 

Number of Header Records in this File 
Number of Data Records following this header 
Number of Columns within each Data Record 
DESCRIPTION OF SECOND LINE IN FILE (BEFORE HEADER) : 

Latitude of Cast (Degrees; South=[-] ; North* W) 

Longitude of Cast (Degrees; West=[-] ; East=[+]) 

Date and Local Time of Cast (Julian Day + Local Time in percent of 24hr) 

Date and G.M. Time of Cast (Julian Day + G.M. Time in percent of 24hr) 

Filename > , w9 10321a . mer 

Cruise Identification >, WHITE POINT OUTFALL - 03/91 

Station Identification >,STA 1 

Date of Cast (Mon/Day/Year) >,03-21-1991 

Local Start Time (Hr:Min:Sec) — >,12:23:41 

Latitude (Degrees Minutes ) >, 33-41.20 N 

Longitude (Degrees Minutes) >,118-20.41 W 

Sky State During Cast >, CLEAR 

Post-cruise (WJR) - Data processed using calibration file listed below. 

Initial data-cleaning limited to occasional data spike or gap removal. 

Data then binned to 1 meter depths. 

09/91 (WJR) - Reprocessed Lu channel using time-averaged comparison between 
original calibration (06/11/87) and SDSU/CH0RS calibration (07/17/91). 

05/93 (WJR) - Ship-roll removed from all surface (Deck) channels. 

05/93 (WJR) - All optical channels normalized to max surface (Deck) channels. 
05/93 (WJR) - All optical channels smoothed to remove wave effects. 

05/93 (WJR) - Ship shadow/reflection removed from affected optical channels. 
08/93 (WJR) - '/Transmission corrected by new calibration 
08/93 (WJR) - '/.Transmission converted to Beam Attenuation 

======*** ss ****============DATA_C0LUMN_DESCRIPTI0NS==================*=*=***=*== 

Column, Column_Title, Description 


0, Depth, Mean Depth of 1-meter record bin (meters) 

1, Pts/m, Number of points averaged per bin (0=interpolated data) 

2, Tilt_, Instrument Tilt (degrees; range -45 to 45) 

3, Roll., Instrument Roll (degrees; range -45 to 45) 

4, TempC, Water Temperature (Deg C) 

5, S_ppt, Calculated Salinity (PPT) 

6, Cond_, Measured Conductivity 

7, Sigma, Calculated Water Density 

8, BeamC, Beam Attenuation Coefficient from 25cm Transmissometer 

9, Fluor, Stimulated Fluoresence (Fluoro units; range 0 to 100) 

10, PARuw, Downwelling Scalar PAR at depth (E17 quanta/sec/cm2) 

11-23, Ed410-Ed710, Downwelling Spectral Irradiance at depth (uW/cm2/nm) 
24-31, Eu410-Eu469, Upwelling Spectral Irradiance at depth (uW/cm2/nm) 
32-39, Lu410-Lu683, Upwelling Spectral Radiance at depth (uW/cm2/nm/str) 
40-43, E+410-E+683 , Spectral Irradiance above sea surface (uW/cm2/nm) 

Depth , Pts/m, Tilt., Roll-, TempC, S_ppt ,Cond_, Sigma, BeamC, Fluor, PARuw, Ed4 10, . . . 

0.50000, 0.00000, 1.81487, 5.48543, 0.00000, 0.00000, 0.00000, ... 

Fig. 32. An example of a final data file. 
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shifting was used only for normalizing and was not applied 
to the final surface light data. The next processing step 
was to smooth out sea-surface wave effects from underwa- 
ter optical channels by applying either a three-, five-, or 
seven-point boxcar mean filter to all underwater optical 
channels. 

As a final step in casts where obvious effects such as 
ship shadow, ship hull reflection, or wave focusing were 
present in the downwelling irradiance (Ed) data, the up- 
per (shallow) portion of each affected Ed channel was re- 
placed with extrapolated, or curve-fit data. This was ac- 
complished using a automated program that makes use of 
the lower non-shadowed optical data and finds the most 
accurate extrapolation to a predefined surface value es- 
timated from the deck cell data. The extrapolation was 
carried out using a least-squares polynomial fit performed 
in log space. For those underwater Ed channels where 
there was no corresponding above-water Ed(0^) channel, 
estimated £<i(0 + ) values were automatically calculated us- 
ing RADTRAN (Gregg and Carder 1990) for the time, day, 
location, and sky conditions. 

4.5 CALCULATION OF K 

The diffuse attenuation coefficient for downwelling ir- 
radiance ( Kd ) was calculated from the Ed profile using a 
least-squares fit of the log-transformed data (Smith and 
Baker 1894). A 9m window (z±4m) was used for cal- 
culating Kd at each depth level. These Kd values were 
not stored but rather were calculated on demand when 
requested. Whenever measured chlorophyll and phaeopig- 
ment data were available, the calculated Kd values were 
overplotted with Kd values as predicted by the model of 
Morel (1988). 

4.6 DATA FILE FORMATS 

There are two file formats used by the AIBOP software 
package. The first is a working format (Fig. 31), which is 
used by the software during all of the processing steps. 
This format keeps the data in the same configuration as 
output by Biospherical Instruments data collection soft- 
ware. The second format is a final format (Fig. 32) which 
is distributed to the public. The final format differs from 
the working format in several ways: 

■ The data column are rearranged in a more logi- 
cal order (e.g., having depth as the first column), 

■ Percent transmission from the transmissometer 
is converted to beam attenuation, and 

■ Greenwich Mean Time (GMT) is calculated for 
each cast and is shown along with local time. 


Also a special plotting line is added which can aid in 
quickly determining the exact location and time of each 
cast. All files are in comma- separated ASCII for ease of 
reading by others. 

4.7 LOG FILES 

A log file was automatically created for each cast which 
lists all of the level -2 spectral processing steps in the order 
they were performed. The log file (Fig. 33) allows for later 
recreation of the processed data, as well as serving as a 
permanent record of the processing session. These log files 
are stored separately from the data files but are available 
to anyone requesting them. 

MER OPTICAL PROCESSING LOG FILE 
FOR: w910321a.mer 
BY: WJR DATE: 05/93 

PROCESSING PERFORMED ON ALL OPTICAL CHANNELS: 
REM0VED_SHIP_R0LL_FR0M_SURFACE 
NORMALIZED_UW_TO_SURF_MAXIMUM 
REMOVED_UW_WAVE_EFFECTS_ (5PTS) 

INDIVIDUAL OPTICAL CHANNELS PROCESSED: 

1, (Ed 410), SHAD0W_REM0VED_ (7,13) 

2, (Ed 441), SHAD0W_REM0VED_ (7 , 13) 

3, (Ed 488), SHAD0W_REM0VED_ ( 1 1 , 15) 

4, (Ed 520), SHAD0W_REM0VED_ (7,17) 

5, (Ed 550), SHADOW_REMOVED_ (3,13) 

6, (Ed 560), SHADOW_REMOVED_ (10,16) 

7, (Ed 589), SHADOW_REMOVED_ (5 , 13) 

8, (Ed 633), SHAD0W_REM0VED_ (9,19) 

9, (Ed 656), SHAD0W_REM0VED_ (7,15) 

10, (Ed 671), SHAD0W_REM0VED_(3,9) 

11, (Ed 683), SHAD0W_REM0VED_ (2,12) 

12, (Ed 694), SHAD0W_REM0VED_ (2,10) 

13, (Ed 710), SHAD0W_REM0VED_(2 , 10) 

17, (Lu 410), NOT PROCESSED 

18, (Lu 441), NOT PROCESSED 

19, (Lu 488), NOT PROCESSED 

20, (Lu 520), NOT PROCESSED 

21 , (Lu 550) , NOT PROCESSED 

22, (Lu 633), NOT PROCESSED 

23, (Lu 656), NOT PROCESSED 

24, (Lu 683), NOT PROCESSED 

25, (Eu 410), NOT PROCESSED 

26, (Eu 441), NOT PROCESSED 

27, (Eu 488), NOT PROCESSED 

28, (Eu 520), NOT PROCESSED 

29, (Eu 550), NOT PROCESSED 

30, (Eu 589), NOT PROCESSED 

31, (Eu 671), NOT PROCESSED 

32, (Eu 694), NOT PROCESSED 

35, (PAR uw), NOT PROCESSED 

END OF MER OPTICAL PROCESSING LOG FILE 

Fig. 33. An example of a log file. 


52 


Siegel, O’Brien, Sorensen, Konnoff, Brody, Mueller, Davis, Rhea, and Hooker 


Chapter 5 


The SIO Method 

Eric A. Brody 

University of California , Santa Barbara, Santa Barbara , California 

Abstract 

The SIO group has employed a bulk method for deriving AOPs from spectroradiometry profiles. The bulk 
approach has been long employed in the past and much of what is known about AOPs is a result of using 
this approach. The bulk method has been used in the past by the SIO group, although, they are not doing so 
presently. The bulk approach fits a straight line to the log-transformed irradiance and radiance profiles within 
the oceanic mixed layer. The fluxes just below the sea surface are estimated from the exponentiated intercept 
and the slope gives a mixed layer averaged diffuse attenuation coefficient, Kd{zo, A). This method provides only 
a single estimate of Kd(zo, A) and cannot be used to determine the depth dependence of Kd{z , A). One distinct 
advantage of the bulk method is that it can easily be applied using any spreadsheet program on a modest 
computer (PC). 


5.1 INTRODUCTION 

For the SIO MER-1012 data, a very simple and conser- 
vative method, based on the traditional Smith and Baker 
(1984 and 1986) method, was used. Now with the new 
MER-2040 and the addition of spectral irradiance above 
the surface, this approach is no longer employed and a 
switch to the BBOP method has been made. A summary 
of the data processing methodology is given below. 

5.2 DATA PROCESSING 

Preparation of the data includes averaging the data to 
aim bins and calculating the mixed-layer depth by visu- 
ally inspecting the temperature, salinity, and beam atten- 
uation data. In addition, an inspection for ship shadows, 
wave focusing, and surface glitter is made to determine 
the shallowest good depth. Sometimes the deepest depth 
is not the base of the mixed layer, but the depth at which 
the downwelling irradiance becames less than 10 times the 
noise levels. This is especially important when solar zenith 
angles are large, or cloudy conditions cause minimal sur- 
face flux. 


In addition, the surface PAR (Eq PAR) is checked to be 
more or less constant during the profiling. If PAR is less 
than O.lx 10 16 Qcm -2 s -1 or varied too much , then the 
data is rejected. Since surface irradiance for each chan- 
nel was not available, the data was not normalized to the 
surface as outlined by Smith and Baker (1984). 

Using the (visually) selected shallowest and deepest 
depths, a least-squares regression fit is applied to the depth 
versus the natural log of a given channel (see for example, 
Smith and Baker 1984 and 1986). The slope is the de- 
rived diffuse attenuation coefficient ( K ) for the mixed layer 
depth and the exponential of the intercept is the data ex- 
trapolated to just below the surface (z= 0"). The ratio 
of water leaving radiance to downwelling irradiance just 
below the surface, Ttu(CU):.Ed(0~), is the remote sensing 
reflectance, R rs (0~). The Fresnel coefficient is not used to 
get values at (z = 0 + ). 

Verifcation of the data involves correlating the mixed 
layer depth chlorophyll and phaeopigment or particle ab- 
sorption with the i?r 5 (0“) and K for the mixed layer depth 
and comparing it to the algorithms (Gordon et al. 1988; 
Smith and Baker 1984 and 1986). 


Editors’ Note: Although this Chapter is not as detailed as the 
others, the editors’ thank the author for making an effort to 
make up for a lack of material from the SIO group. 
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Appendix A 

Attendees to the First SeaWiFS 
Data Analysis Round-Robin (DARR-94) 

The attendees to DARR-94 are presented alphabetically. 

Karen Baker 
UCSD/SIO 
La Jolla, CA 92093 
Voice: 619-534-2350 
Fax: 619-534-2996 

Net: karen@icess.ucsb.edu 

Eric Brody 

UCSB/ICESS 

Santa Barbara, CA 93106 

Voice: 805-893-4449 

Fax: 805-893-2578 

Net: ebrody@icess.ucsb.edu 

Curtiss Davis 

Naval Research Laboratory 
Code 7212 

Washington, DC 20375 
Voice: 202-767-9296 
Fax: 202-404-7453 

Net: davis@rira.nrl.navy.mil 

Vincent Fournier-Sicre 
UCSD/Scripps Oceanography 
La Jolla, CA 92093-0218 
Voice: 619-534-8947 
Fax: 619-534-2997 

Net: fournier@spode.ucsd.edu 

Stanford Hooker 

NASA/GSFC/Code 970.2 

Greenbelt, MD 20771 

Voice: 301-286-9503 

Fax: 301-286-1775 

Net: stan@ardbeg.gsfc.nasa.gov 

John Morrow 

Biospherical Instruments, Inc. 

5340 Riley Street 

San Diego, CA 92110 

Voice: 619-686-1888 

Fax: 619-686-1887 

Net: morrow@biospherical.com 

James Mueller 
SDSU /CHORS/Suite 206 
6505 Alvarado Road 
San Diego, CA 92120-5005 
Voice: 619-594-2230 
Fax: 619-594-4570 

Net: jim@chors.sdsu.edu 

Margaret O’Brien 

UCSB/ICESS 

Santa Barbara, CA 93106 

Voice: 805-893-2544 

Fax: 805-893-2578 

Net: mob@icess.ucsb.edu 


W. Joseph Rhea 

Naval Research Laboratory 

Code 7212 

Washington, D.C. 20375 
Voice: 202-767-9296 
Fax: 202-404-7453 

Net: rhea@riva.nrl.navy.mil 

Dave Siegel 
UCSB/ICESS 
Santa Barbara, CA 93106 
Voice: 805-893-4547 
805-893-2544 
Fax: 805-893-2578 

Net: davey@icess.ucsb.edu 

Ray Smith 
UCSB/ICESS 
Santa Barbara, CA 93106 
Voice: 805-893-4709 
Fax: 805-893-2578 

Net: ray@icess.ucsb.edu 

Jens Sorensen 
UCSB/ICESS 
Santa Barbara, CA 93106 
Voice: 805-893-4449 
Fax: 805-893-2578 

Net: jens@icess.ucsb.edu 

Glossary 

AIBOP Automated and Interactive Bio-Optical Processing 
ANSI American National Standards Institute 
AOP Apparent Optical Property 
ASCII American Standard Code for Information Inter- 
change 

BATS Bermuda Atlantic Time-Series Station 
BBOP Bermuda Bio-Optics Project 
BOPS Bio-Optical Profiling System 

CalCoFI California Cooperative Fisheries Institute 
CHORS Center for Hydro-Optics and Remote Sensing (San 
Diego State University) 

COARE Coupled Ocean-Atmosphere Response Experiment 
CTD Conductivity, Temperature, and Depth 
c.v. coefficient of variation 
CVT Calibration and Validation Team 

DAAC Distributed Active Archive Center 
DARR Data Analysis Round- Robin 
DARR-94 The First DARR (July 1994) 

DEC Digital Equipment Corporation 

EC Excluding CHORS (data) 

EqPac Equatorial Pacific (Process Study) 

FORTRAN Formula Translation (computer language) 
ftp file transfer protocol 

GLOB EC Global Ocean Ecosystems 
GMT Greenwich Mean Time 
gcc GNU C Compiler 
GNU GNU’s not UNIX 
GOMEX Gulf of Mexico Experiment 
GSFC Goddard Space Flight Center 
GUI Graphical User Interface 
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IBM International Business Machines 
ICESS Institute for Computational Earth System Science 
(University of California at Santa Barbara) 

IDL Interactive Data Language 

IRIX Not an acronym, a computer operating system. 

JGOFS Joint Global Ocean Flux Study 

KQ Kd Quality (flag) 

LCD Least Common Denominator (file) 

MER Marine Environmental Radiometer 
MOBY Marine Optical Buoy 

NASA National Aeronautics and Space Administration 
NRL Naval Research Laboratory 
NSF National Science Foundation 

PAR Photosynthetically Available Radiation 
PC (IBM) Personal Computer 

rms root mean squared 

SDSU San Diego State University 
SeaBASS SeaWiFS Bio-Optical Archive and Storage System 
SeaWiFS Sea- viewing Wide Field-of-view Sensor 
SGI Silicon Graphics, Incorporated 
SIO Scripps Institution of Oceanography 
SIRREX SeaWiFS Intercalibration Round-Robin Experiment 
SNR Signal-to-Noise Ratio 
SUN Sun Microsystems 
SXR SeaWiFS Transfer Radiometer 

TOGA Tropical Ocean Global Atmosphere program 

UCSB University of California at Santa Barbara 
UNESCO United Nations Educational, Scientific, and Cul- 
tural Organizations 

UNIX Not an acronym, a computer operating system. 
WOCE World Ocean Circulation Experiment 

Symbols 

Ad(z,X) Linear regression intercepts at the center of a fitted 
depth interval for In of A d {z, A) defined in (17). 

An ( 2 , A) Linear regression intercepts at the center of a fitted 
depth interval for In of A u (z, A) defined in (17). 
Ai(z y A) Linear regression intercepts at the center of a fitted 
depth interval for In of Aj(z, A) defined in (17). 

E( A) Spectral irradiance. 

Ed{ 0“,A) Incident downwelling spectral irradiance just be- 
neath the sea surface. 

Ed(z, A) Incident downwelling spectral irradiance profile. 
E 3 (z, A) Vertical profile of surface irradiance. 

E 3t i( A) The value of E 3 (z,X) at node depth z*. 

E s (z rni A) Defined as M.E S (X). 

E s ( A) The measured irradiance vector of length M. 
£ U (0-,A) Upwelling spectral irradiance just beneath the sea 
surface. 

E u (z, A) Upwelling spectral irradiance profile. 


K 

K d (z,X) 
K'd(ZyX) 
K l (z, A) 
K' l (z,X) 

K u (z,\) 

K{z,\) 

Li 

L U (0-,A) 

£.«.(*, A) 

M 

N 

Wtti 

Z 

Zi 

Zm 

Zn 

7 ij 
X 

s 

a 

o t 

<*e 


f(z,A) 

t(z,A) 


Diffuse attenuation coefficient. 

Vertical profile of the diffuse attenuation coefficient 
for the downwelling irradiance spectrum. 

K d {z, A) determined by least squares regression over 
a depth interval. 

Vertical profile of the diffuse attenuation coefficient 
for the upwelling radiance spectrum. 

Kl(z,X) determined by least squares regression over 
a depth interval. 

Vertical profile of the diffuse attenuation coefficient 
for the upwelling irradiance spectrum. 

K u (z, A) determined by least squares regression over 
a depth interval. 

The length of the zth element. 

Upwelling spectral radiance just beneath the sea 
surface. 

Upwelling spectral radiance profile. 

Total number of discrete data points in a vertical 
radiometeric profile. 

The number of node depths. 

Vertical profile of the remote sensing reflectance 
spectrum. 

The weighting coefficient at each depth z m . 

The vertical coordinate. 

The depth of a particular node. 

The depth of the mth data point in a vertical ra- 
diometric profile. 

The node depth number (n = 0, . . . ,iV — 1). 

Hermit ian cubic basis function. 

Wavelength of light. 

A local depth coordinate ranging from —1 at node 
Zi - 1 to +1 at node Zi. 

One standard deviation. 

The density of sea water determined from the in 
situ salinity and temperature, but at atmospheric 
pressure. 

The density of sea water determined from the in 
situ salinity and the potential temperature ( 9 }, but 
at atmospheric pressure. 

The estimated vertical profile of the spectral optical 
depth. 

Vertical profile of the spectral optical depth. 
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